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THE lEA STUDY OF READING LITERACY 
TEE STUDY IN BRIEF 

Countries 

In 1990-1991 thirty-two school systems were involved in the DBA Reading 
Literacy Study. Participating in the study were: 



Belgium (French) 
Botswana 

Cypnui 
D^imaric 



Gcnriany (West) 
Iceland : 



Finland Indonesia 
Francv* Ireland 
Germa^xy (East) Italy 



Nedmlands 
N^w Zealand 

Nigdia^ ■■' . 
Npcmiy 
Philil^ines 

Portugal 

Singapore 

Slovenia 



\ 



Spain 
i Sweden ; 
Switzerland 
lluttland 
Tdiiidad& 
Tobago 
Uiuted States 
Venezuela 
Zimbabwe 



Data was col: ected from a very large number of schools, teachers and students. 
The size of tho study can be seen from the total numbers involved. 



1590-1991 

Population A 
Population B 
Total 



Schools 

4,353 
4,720 
9,073 



Teachers 

4,992 
5,526 
10,518 



Students 

93,039 
117,020 
210,059 



Target Populations 

Population A: All students attending school on a full-time basis at the grade 
level in which most students aged 9:(X)-9: 1 1 years were enrolled 
during the first week of the eighth month of the school year. 

Population B: All students attending school on a full-time basis at the grade 
level in which most students aged 14:00-14:11 years were 
enrolled during the first week of the eighth month of the school 
year. 

Testing Program 

All students took reading tests for two sessions totaling 75 minutes at the 
Population A level and two sessions totaling 85 minutes at the Population B 
level. 

Questionnaires 

All students responded to a background questionnaire about their reading at 
nome and at school. Teachers and school principals responded to questionnaires 
about themselves, their teaching and the school organization. Each National 
Center completed a National Case Study Questionnaire. 
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PREFACE 



In the late 1950s a group of leading educational research workers met in England 
and at the Unesco Institute of Education in Hamburg to discuss common 
problems in the conduct of educational research. From their deliberations they 
recognized the need for a comparative research program that was empirically 
oriented and that investigated problems which were common to many national 
systems of education. They saw the world of education as a natural laboratory 
in which different countries were experimenting with different strategies of 
teaching and learning. By examining the naturally occurring differences be- 
tween countries in both the conditions of learning and educational outcomes, 
they thought it might be possible to identify the significant factors that 
influenced educational achievement. The program of research would be both 
comparative and cooperative. Decisions were to be made through scholarly 
debate and not political pressure. Members of the organization would be 
research centers and scholars with the competence to undertake survey research. 
For over 30 years the organization that developed from these early discussions 
has undertaken a continuing program of research. This organization, formally 
called the International Association for the Evaluation of Educational Achieve- 
ment, is now commonly referred to as lEA. 

In 1988, the lEA General Assembly, composed of the research institutes 
participating in lEA projects, decided to undertake a study of Reading Literacy. 
A Steering Committee of six members was formed and a technical advisory 
group appointed. (See Appendix A for a list of study personnel.) The chairper- 
son of the Steering Committee was Professor Warwick B. EUey from New 
Zealand. He is the author of this first booklet of a series and presents the 
preliminary results of the study. An International Coordinating Center (ICC) 
was established at the Faculty of Education at the University of Hamburg, 
Germany, under the direction of Professor T. Neville Postlethwaite. Research 
institutes from thirty-two systems of education participated in the study. Each 
of them appo j nted a National Research Coordinator (NRC) to be responsible for 
the day-to-day running of the study in their own countries. All conceptual and 
operational decisions were made cooperatively by the Steering Committee and 
NRCs. 

The study held its first NRC meeting in November 1988. The construction 
and pilot testing of instruments was conducted in the period November 1988 to 
July 1990. The main testing took place in the period October 1990 to April 1991 
depending on the school year in each country. 

The na:\.nal costs of conducting the study were borne by the research 
institutes acting as the National Centers in each country. The international costs, 
amounting to US $615,000 from November 1988 to May 1992, came from the 
participating countries themselves, the MacArthur Foundation, the Mellon 



Foundation, the National Center for Educational Statistics through the National 
Academy of Sciences, the European Community, the Maxwell Family Founda- 
tion and Unesco. 

The study could not have been conducted without a great deal of goodwill, 
support, and cooperation from the National Centers involved in the study. The 
members of the Steering Committee and the Technical Advisers worked 
without financial recompense of any kind. NRC meetings were hosted by some 
of the National Centers. 

lEA thanks all of those involved for their contributions to this major 
international investigation. In particular, DBA thanks Professor Warwick B. 
EUey, the author of this first booklet to emerge from the lEA Reading Literacy 
Study, His commitment and unstinting work for the study have been enormous. 



T, Plomp 
Chairman of lEA 
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lEA STUDY OF READING LITERACY 

EXECUTIVE SUMMARY 

This booklet focuses on the reading hterac ' test scores of students in the grade 
levels where most 9- and 14-year*olds were to be found in 32 systems of 
education. It describes the achievement levels of carefully selected probability 
samples of students in three domains of reading literacy and makes some 
preliminary interpretations of these results. 

The comparisons made in the test scores requke the reader to assume that the 
tests were equally fair for all countries, that the tests were properly translated and 
administered, and that the student samples were comparable in age, in test 
motivation, and in their approach to test-taking. Much effort was taken to ensure 
and to check on these possible influences. Where differences were still found to 
exist - for instance, in mean ages - comments have been made in the text and 
adjustments to the scores have been attempted. 

The following findings have emerged from the initial analyses of this survey 
of achievement. 

1 . National achievement levels. 

The students of Finland showed the highest reading literacy levels at both 
9 and 14 years of age in almost all domains. Students in the United States 
also produced relatively high scores at the nine-year-old level, and in 
Sweden, France, and N.ew Zealand at the fourteen-year-old level. 

2. Domain profiles. 

The levels of reading literacy achieved in each country are highly correlated 
across all three domains, and across both age groups. However, fourteen- 
year-old students in Cyprus and Greece showed greater strength in the 
Narrative domain, while students in Hong K'^^^g, Switzerland, Germany 
and Denmark performed better in Document . at both age levels, 

3. Economic and social context. 

For most countries, the levels of reading literacy are closely related to their 
national indices of economic development, health, and adult literacy. 
Nevertheless, Hong Kong attained high levels of achievement at both age 
levels with only average status on these developmental indices. Nine-year- 
olds in Finland and Italy, and fourteen-year-olds in Hungary, Portugal 
and Singapore also achieved well above the scores expected on the basis of 
developmental indices. 

4. Home language. 

The students of Singapore achieved high levels of literacy in spite of the fact 
that they were instructed in a non-native language from the beginning of 
their schooling. This finding is unexpected and potentially important. 



5. Age of beginning instruction. 

Formal instruction did not begin until age seven in four of the ten highest- 
scoring countries at each level. Apparently a late start is not a serious 
handicap in reading instruction, when judged at age nine. However, when 
achievement scores were adjusted for economic and social circumstances 
across all countries, an earlier start was generally found to be an advantage. 

6. Differences between high- and low-scoring countries. 

Factors which consistently differentiated high-scoring and low-scoring 
countries were large school libraries, large classroom libraries, regular 
book borrowing, frequent silent reading in class, frequent story reading 
aloud by teachers, and more scheduled hours spent teaching the language. 
Several countries with low scores reported very little experience with 
formal tests, but above a threshold level, this factor was not found to 
differentiate high- and low-achieving countries. At the 14-year-old level, 
additional factors which helped differentiate high-scoring countries from 
low-scoring countries were more general homework, more literacy re- 
sources in the school, more individual tuition, fewer non-native speaking 
teachers, a shorter school year, and more female teachers. 

7. Less important differentiating factors. 

At the nine-year-old level, no perceptible advantage was found in reading 
literacy levels of countries which had high enrollment ratios in preschool, 
or generally smaller classes, or large numbers of multi-grade classes, or 
longer school years, or policies of keeping the teachers with the same class 
throiigh successive grades. While many of these policies were found 
regularly in high-scoring countries, the data suggest that their importance 
may well be only a function of relative affluence and community factors 
outside the school. 

8. Gender differences. 

Girls achieved at higher levek than boys in all countries in Population A, 
and in most countries in Population B. The mean difference, favoring girls, 
dropped fron ! 2 points to 7 points at age fourteen. Girls showed the largest 
advantage iu ihe Narrative domain, and the smallest in Documents. In 
countries which begin formal instruction at age five, boys showed lower 
scores, relative to girls. 

9. Language differences. 

Children whose home language is different from that of the school show 
lower literacy levels in all countries at both age levels. The differences 
between these children and speakers of the language of instruction are 
greatest in New Zealand in both populations. 

10. Urban-rural differences. 

Urban children achieve at higher levels than rural children in most educa- 
tion systems. However, in a few highly developed countries, rural students 
show literacy levels which are as good as, or better than their city age mates. 



11. Importance of books. 

The availability of books is a key factor in reading literacy. The highest 
scoring countries typically provide their students with greater access to 
books in the home, in nearby community libraries and book stores, and in 
the school. 

12. Links with television. 

Television viewing occupies much of students' out-of -school discretionary 
time. In a few countries large numbers of children watch TV for more than 
five hours per day. Those who watch TV often tend to score at lower levels 
than those who watch less, as a general rule. However, in a small number 
of countries, children who watch for three to four hours daily have the 
highest reading scores. In these countries imported films with subtitles in 
the local language are often shown. 

13. Self' ratings. 

Within all countries, good readers perceive themselves to be above average 
in reading ability on the whole, but the accuracy of their judgments varies 
considerably across countries. Students of Fi>a.AND, Hong Kong, Singapore, 
and Hungary are relatively modest about their reading; students of Greece, 
Cyprus, the United States and Canada (BC) are relatively confident. 

14. Becoming a good reader. 

When asked how they could become good readers, students in most 
countries emphasized such factors as Liking it, Having lots of time to read, 
and Concentrating well. Younger students in many countries also stressed 
Knowing how to sound out words, especially in Spain and Venezuela, but 
not in Norway, New Zealand and Hong Kong. The best readers in the high- 
scoring countries emphasized Having many good books around. Learning 
many new words and Doing many written exercises. By contrast, the best 
readers in low-scoring countries stressed Sounding out the words. Regular 
drill on the hard things, and Doing much reading for homework. These 
national differences are believed to reflect variations in teaching emphases. 

15. Voluntary reading. 

The amount of voluntary out-of-school book reading that students report is 
positively related to their achievement levels. This relationship is clearer at 
the 9-year-old level, and in the developing countries at age fourteen. 
Howevei, the findings reveal an optimum level of voluntary book and 
magazine reading in Population B beyond which additional reading ap- 
pears not to enhance achievement as juds^<5 by these tests. 
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CHAPTER ONE 



WHAT IS THE STUDY ABOUT? 
The Challenge 

To acquire the ability to read is a fundamental human right and a basic 
requirement for individual and national development in the 1990s. Yet for 
nearly one fifth of the earth's population, the printed word has nothing to say. 
The Unesco publication. World Education Report 199 L states that more than 
950 million adults are unable to read and write (Unesco 1 99 1 , p. 22). Moreover, 
educators around the world hold widely differing views about how best to teach 
students to read. 

In many countries phonics teaching is paramount; in a few, phonics is a dirty 
word. In some systems primary school begins at age five; in others, it is delayed 
until age seven. In many nations students work systematically through commer- 
cially produced sets of graded readers; in others students are believed to learn 
best through a rich and varied diet of children's literature. Teachers in some 
countries insist on regular workbook exercises; elsewhere they require only that 
children enjoy and talk about what they read. Some argue strongly for small 
group activities; others believe children should be taught as a whole class. 

There are many other differences in policies between nations - from the 
number of days spent in school to the training of teachers, the size of classes, the 
frequency of testing, and the extent of homework, to name but a few. Many of 
these differences are debated within countries; others are nationwide traditions 
and taken for granted by most educators and parents. 

An international study of these diverse policies is well justified in itself. If 
such a study also attempts to relate them to carefully devised indicators of the 
levels of achievement reached in reading literacy by students in each country, 
it may well be able to throw important light on which, if any of these policies 
have important consequences for students' progress in reading. The researchers 
involved in the study accepted this challenge - to assess differences in the 
reading achievement levels and voluntary reading activities of 9- and W-year- 
old students in each of 32 systems of education, and to link these differences to 
variations in policies and practices across countries. It proved an awesome 
challenge, and many critics of literacy assessment procedures across languages 
and cultures questioned its feasibility. However, the challenge was accented, as 
the likely benefits appeared to outweigh the costs, and the results of piiot tests 
conducted in many of the countries greatly increased the researchers' optimism 
about the viability of the project. 

This booklet reports the initial results of this enormous international research 
exercise, the largest of its kind. The report describes and attempts to interpret the 
aveiage achievement levels in reading literacy of some 210,000 children in 32 
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educational systems on every continent of the earth. For each country the report 
breaks down these outcome measures by gender, home background, native 
language, book resources, and other sub-groups of interest. More detailed 
analyses are reported in a number of booklets and in a full international report. 
A separate technical report presents more technical details. 

The Study 
How was the study conducted? 

The International Association for the Evaluation of Educational Achievement 
(lEA), which conducted the study, is a network of national educational research 
organizations in some 50 countries. It was created in order to carry out 
comparative surveys of schooling in its member countries. The lEA General 
Assembly approved the Reading Literacy Study in 1986 and planning was 
undertaken by an International Steering Committee (appointed by the lEA 
General Assembly) with the aid of representatives from each of 35 participating 
countries, starting in Washington, DC, in late 1 988. An International Coordinat- 
ing Center was established in Hamburg, Germany (see Appendix A for persons 
involved in the study). 

The Steering Conmiittee, consisting of researchers from six countries, 
proposed the major aims and guidelines. These were modified and extended at 
several international meetings by representatives, called National Research 
Coordinators (NRCs), from each participating institution. Items for the tests and 
questionnaires were generated, translated and pilot tested by these NRCs in 
1989-1990. After analysis of the pilot data by the research staff at the Interna- 
tional Coordinating Center in Hamburg, the final tests were selected by the 
Steering Committee and NRCs in July 1990. 

The formal survey was conducted on scientifically selected national samples 
of 9- and 14-year-olds, typically 1,500 to 3,000 pupils per country, and their 
teachers in 1990-1991. The tests and questionnaires were administered under 
standardized conditions to the national samples in the eighth month of the school 
year of 1990-1991. Southern hemisphere countries administered the tests six 
months earlier to coincide with their school year. 

Where necessary, tests were translated into the local language under the 
supervision of NRCs and according to guidelines provided by the Steering 
Committee. Two parallel translations of the tests were requested and back 
translations were asked for on sample passages and items as a check for 
accuracy. Further checks were conducted by studying the patterns of item 
analysis results across countries. Layout, illustiations, instructions, and time 
limits were standardized, but minor cultural adaptations were permitted to allow 
for more suitable place names, people's names, local currencies and measure- 
ment units. 
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What were the major aims of the study? 

As in earlier lEA studies, the Steering Committee gave priority to the task of 
surveying achievement levels in comparable samples of students in each 
country. The first aim then, accepted by all, was to determine the average levels 
of reading literacy of representative samples of all students in the grades where 
most 9- and 14-year-olds were to be found. These two groups were called 
Population A and Population B respectively. 

This aim is the focus of this report. Why choose the grade levels of 9- and 14- 
year-olds? An earlier lEA study of reading achievement in 15 countries 
(Thomdike 1973) had chosen 10-year-olds as the first population to be sur- 
veyed. However, the author suggested in hindsight, that a younger age might 
have been more fruitful. It might well allow the identification of important 
factors associated with learning to read. The age of 14 years was set as the most 
suitable for the survey of older students because it was found to be the final year 
of compulsory schooling in many countries. Thus it represented the level of 
achievement in literacy likely to be attained by school leavers in these countries. 
Such levels represent the quality of reading to be expected in the next generation 
of citizens. 

Other aims adopted by NRCs, some of which are reported on in later 
publications, include the following: 

• To describe the voluntary reading activities of 9- and 14-year-olds; 

• To identify differences in policies and instructional practices in reading, 
and to study the ways in which tliey relate to students' achievement and 
voluntary reading; 

• To produce valid international tests and questionnaires which could be used 
to investigate reading literacy development in other countries; 

• To provide national baseline data suitable for monitoring changes in 
reading literacy levels and patterns over time. 

What is reading literacy? 

For the purposes of the study, reading literacy was defined as: 

. .Jhe ability to understand and use those written language forms 
required by society and/or valued by the individual. 
Such a definition was found to be general enough to accommodate the 
diversity of traditions and languages represented in the participating countries, 
but specific enough to provide some guidance for test construction. Writing 
ability was deliberately excluded from the definition, and only a minimal 
amount of writing was required of students throughout the testing process. The 
emphasis on language forms required by society reflects the concept of 
functional literacy and coping with reading tasks frequently encountered in an 
organized society - reading notices, newspapers, maps, graphs and government 
circulars. However, a broader definition was required to meet the needs of many 
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National Committees who argued for the inclusion of higher-level thinking and 
the interpretation of narrative prose and magazine articles. Hence the additional 
notion of materials valued by the individual. While the majority of NRCs 
favored an emphasis on both understanding and use, the constraints of mass 
testing, standardized conditions, traditional policies, and limited school time in 
many nations, made it imperative that the major stress be placed on understand- 
ing. Nevertheless, it was found possible to measure students' ability to follow 
directions in a few tasks. 

The major domains or types of reading literacy materials to be included in 
the final tests of both age levels were as follows: 

1 . Narrative prose: Continuous texts in which the writer's aim is to tell a story 
- v/hether fact or fiction. They normally follow a linear time sequence and 
are usually intended to entertain or involve the reader emotionally. The 
selected extracts ranged from short fables to lengthy stories of more than 
1,000 words. 

2. Expository prose: Continuous texts designed to describe, explain, or 
otherwise convey factual information or opinion to the reader. The tests 
contained, for example, brief family letters and descriptions of animals as 
well as lengthy treatises on smoking and lasers. 

3. Documents: Structured information displays presented in the form of 
charts, tables, maps, graphs, lists or sets of instructions. These materials 
were organized in such a way that students had to search, locate and process 
selected facts rather than read every word of continuous text. In some cases, 
students were required to follow detailed instructions in responding to such 
documents. 

Other forms of classifying reading tasks were investigated and are used when 
appropriate in other publications of this series. 

The Tests 

What form did the tests take? 

In order to demonstrate their levels of reading literacy, students had to read a 
balanced sample of each of the three types of materials, and answer questions 
to show how well they could understand and/or use them. The expository and 
document materials were drawn from typical home, school, society or work 
contexts, with a somewhat greater emphasis on the school. From the outset, it 
was agreed that test scores would be reported separately for each of the three 
domains - Narrative, Expository and Documents. 

Another type of task, a Word Recognition Test, was added for the 9-year-old 
students. This task required students to match simple, individual words with a 
corresponding picture (selected out of four), and was administered under 
speeded conditions. It provided weaker students with a task they could manage, 
and was designed to show whether weaknesses observed in reading comprehen- 
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sion in a group of students could be attributed to their inability to decode quickly 
words of high familiarity. 

One way to produce a clear operational definition of the nature of reading 
literacy, as interpreted in this study, is to present a two-way blueprint of the tests 
classified by domain (Table 1.1). 

Table 1.1. Two-way blueprint of tests by domain. 





Peculation A 
(9-year-olds) 


Population B 
(14-year-olds) 


Domains 


No, of 
passages 


No. of 
items 


No. of No. of 
passages items 


Woid 

Recognition 
Narrative 
Expository 
Documents 


4 

5 
6 


40* 

22 
21 
23 


5 29 
5 26 
9 34 


Total 


15 


66 


19 89 



*The Word Recognition items were not included in the analysis of the main set 
of test items. 

What kinds of test items were used? 

Students in most countries were familiar with the multiple-choice format and 
this type was preferred by most NRCs. Such items were considered to be both 
objective and versatile and to be quickly scored, an important consideration in 
large surveys. However, a number of NRCs made a case for including more 
open-ended items on the grounds that they were more life-like and could assess 
important higher level outcomes not measured by objective tests. On the other 
hand, the practical difficulties and cost of scoring the responses counted against 
the use of such items. In order to throw more light on this issue, two members 
of the Steering Committee conducted a study of multiple-choice versus open- 
ended items on the same reading passages drawn from the pilot tests for 9-year- 
olds. The results of this study (EUey and Mangubhai 1992) confirmed the 
findings of other such studies in reading, namely, that in reading surveys both 
types of items measure essentially the same abilities, and that multiple-choice 
items do so in less time, with less cost and are more popular with students. While 
there are clear reasons for using more open-ended questions in diagnostic testing 
and other classroom assessment, the value of including many such items in an 
international survey of reading literacy had not been empirically demonstrated 
before this study was conducted. In the final tests, however, there were four 
completion-type items (one- or two-word answers) and two paragraph-length 
answers selected for inclusion in the 9-year-olds' test, and twenty completion- 
type and two paragraph-length answers in the 1 4-year-olds' test. The paragraph- 
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length answers were scored locally and were not included in the international 
data reported here. Appendix B reports further information on the international 
validity of the Reading Literacy tests. 

HoM' were the tests scored? 

To obtain raw scores, all correct answers were totaled for each student in each 
domain. The Rasch procedure was used to produce scales for each domain. Each 
scale was given a mean of 500 and a standard deviation of 100. The meaning of 
these scoies is explained when the results are presented in Chapters 3 and 4. The 
rationale for the scoring procedure is given in Appendix C. 

What other information was collected? 

At meetings of the NRCs, the following questionnaires were designed to obtain 
information from each system about factors related to reading. 

1. Student Questionnaires on the studen's' home and school circumstances; 

2. Teacher Questionnaires on each teacher's background, instructional prac- 
tices and beliefs; 

3. School Questionnaires on the school circumstances and policies as viewed 
by the principal; 

4. National Case Study Questionnaires completed by NRCs on national 
policy, enrollment patterns and economic conditions. 

Who was tested? 

In each country. Population A consisted of the students in the grade level 
containing the most 9-year-olds, and Population B consisted of the students in 
the grade level containing the most 14-year-olds (see Appendix D for details). 

To obtain comparable samples of students, multi-stage sampling was used 
in each country and schools or classes were typically drawn with a probability 
proportional to the size of the school or class. Where schools were drawn, an 
intact class was selected at random within each school, but i n Population B some 
NRCs selected students at random from all classes in the grade level in the 
school. 

To overcome fluctuations in the execution of the sampling, weighting was 
used to adjust for any variations in the probability of selecting students. These 
sampling weights were used in all data analyses. 

In three of the smaller countries, all students in the relevant grade level were 
tested. Further details on sampling are given in Appendix D. It should be noted 
that most countries achieved over 90 percent response rates. Only Italy, 
Portugal, the UNrrED States and Venezuela had between 80 and 90 percent in 
the Population A sample. In Nigeria, Thailand and Zimbabwe the number of 
schools or classes in the Population B sample was actually less than 80 percent 
of the classes in the planned sample. 
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CHAPTER TWO 



A WORD ON INTERNATIONAL COMPARISONS 

What Cautions Should Be Observed? 

In comparing various countries - or anything else, for that matter - one should 
examine the degree to which the bases for the comparisons are fair and valid. 
Besides differing in language and culture, countries differ substantially in 
wealth, development, and the resources available to education. Is it fair and valid 
to compare the performance of countries that vary in so many different ways? 
Is it possible to adjust the performance levels of countries to make comparisons 
fair and valid? There are no clear answers to these questions. The fairness and 
validity of any comparison are matters of degree, and the adequacy of any 
comparison will depend on the use to which it is put and the alternatives 
available for decision-making. Are there better bases for making judgments? 

The design and implementation of this study of reading literacy has at- 
tempted to make international comparisons as fair and valid as possible, 
although still imperfect. There exist at least three threats to fair and valid 
comparisons: the student population, the reading tests, and the translation 
process. More detailed discussion of these factors is presented in the Technical 
Report. 

The student populations 

An obvious problem in international comparisons is that different nations may 
be represented by substantially different populations as, for example, if the elite 
students of one nation .re compared with the general population of another. To 
avoid this pitfall, the researchers defined the student populations at grade levels 
at which almost all students were in school. In practice, a few countries varied 
from this definition because sampling non-government schools could not be 
done or because the testing of language minorities was impractical. These 
exceptions are noted in the appropriate places. In each country, probability 
samples of the defined populations were selected under the supervision of an 
international sampling coordinator to ensure fair representations from the 
defined population, and almost all nations met the stringent sampling require- 
ments. However, varying educational policies on age of entry to school and 
retention versus age promotion resulted in some small but noticeable differ- 
ences in the ages and grades of the student populations. Thus, countries did vary 
in the proportions of 9-year-olds and 14-year-olds in the grades they selected. 
The effects of these differences are discussed in Appendix E. 
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The tests of reading literacy 

Comparisons would clearly be unfair if the measuring instrument represented 
the curricular emphasis of only one or a few different countries. To avoid this 
problem, all countries were invited to submit questions for inclusion in the 
international test, and most of them did. The test, therefore, is representative of 
the reading curriculum and achievement criteria in many countries, and in a 
sense is a consensus of what students in different countries are expected to be 
able to do. The pools of items generated by the NRCs were trialled and pretested 
by an extensive series of pilot tests that were designed to ensure that the items 
operated in a similar fashion in the countries participating in the study. The final 
selection of items was agreed upon by the NRCs and their National Committees. 
However, this care in constructing an international test cannot remove bias that 
might emerge due to differences in familiarity with testing in general, or with 
multiple-choice items in particular. (SeeAppendix B for more details.) 

The translation process 

Any translation process entails the possibility that the meaning is lost in 
translation, and an international test is no exception. To guard against this type 
of bias, test items were translated independently from the source language by 
native speakers according to common guidelines, then compared and revised. 
Every effort was made to ensure that the original sense of the text and items was 
maintained. Moreover, the items were examined after the pilot test and again 
after the final test to ensure that they behaved similarly in different countries. 
(See Appendix B for more details on the comparability of tests.) 

Despite the extensive effort to make international comparisons as fair and 
valid as possible, there is a point beyond which the technical aspects of the study 
cannot reach. In general this report presents the simple data summaries and 
leaves the reader to judge the adequacy of the comparisons. Throughout the 
report, threats to validity and fairness will be noted. It is argued, frankly, that 
these comparisons - either adjusted or not adjusted - are useful for many 
purposes and are certainly better than alternative omparisons made without 
carefully controlled empirical data. In the end, however, each reader must 
decide for him or herself whether a comparison is adequate for a particular 
purpose. 

How Do Countries Vary in their Economic 
and Cultural Contexts of Literacy Education? 

Some nations are able to give their children a head start in any comparison of 
achievement levels in reading literacy. Where students typically come from 
literate, economically secure homes and attend well-resourced schools with 
well-qualified teachers one would expect higher achievement levels. By con- 
trast, there are some countries where the level of economic and social develop- 
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ment is low and literacy traditions are still limited. Inevitably, there will be fewer 
schools in such places^hai are well-endowed with libraries, textbooks and welU 
trained teachers. 



Table 2.1. 



Counirv 



Selected national indicators of development in 32 participating 
countries and the Composite Development Index (CDI). 



(1) 
GNP per 
capita 
(SUS) 



(2) 
Public 
exp. per 
student 
on educ. 
(SUS) 



(3) 
Life 
expect- 
ancy 



(4) 
% Low 

birth 
weight 



(5) 


(6) 




CDI 


News- 


% Adult 


Com- 


papers 


literacy 


posite 


rank 


oer 




devel. 




1000 




index 




OOP 








219 


99 


3.41 


13 


16 


71 


1.63 


29 


254 


99 


3.66 


7 


125 




2,74 


21,5 




99 


3.64 


10 




99 


3.89 


5 


193 


99 


3,48 


11 


585 


99 


3.44 


12 


347 


99 


3.65 


8.5 


102 


93 


2.74 


21.5 


239 


88 


2.85 


18 


273 


98 


2.51 


24 


562 


99 


3.98 


4 


21 


74 


1.06 


31 


175 


99 


3.09 


16 


105 


97 


3.13 


15 


314 


99 


3.65 


8.5 


327 


99 


3.25 


14 


22 


43 


0.51 


32 


551 


99 


4.15 


3 


56 


86 


1.28 


30 


41 


85 


2.31 


25 


289 


86 


2.78 


20 


151 


99 


2.97 


17 


75 


95 


2.79 


19 


526 


99 


4.20 


2 


504 


99 


4.29 


1 


48 


91 


1.75 


27 


139 


96 


2.64 


23 


259 


99 


3.67 


6 


164 


87 


2.23 


26 


24 


83 


1.65 


28 


236.4 


91.9 


2.91 




182.5 


11.7 


0.96 





Belgium/Fr 

Botswana 

Caiiada/BC 

Cyprus 

Denmark 

Finland 

France 

Gennany/E 

Gemiany/W 

Greece 

Hong Kong 

Hungary 

Iceland 

Indonesia 

Ireland 

Italy 

Medierlands 

New 

Zealand 

Nigeria 

Norway 

Philippines 

Portugal 

Singapore 

Slovenia 

Spain 

Sweden 

Switzerland 

Thailand 

Trinidad/ 

Tobago 

United 

States 

Venezuela 

Zimbabwe 



14,490 


2,772 


75 


5 


1,010 


292 


67 


8 


16,960 


4,096 


77 


6 


5,200 


902 


75 


— 


18,450 


3,390 


75 


6 


18,590 


2,989 


75 


4 




2.912 


76 


5 


11,300 


1,697 


73 


6 


1 0,'tOU 


3,021 


75 


5 


4,800 


462 


77 


6 


9,220 


843 


77 


— 


2.460 


768 


70 


10 


16,596 


— 


77 


3 


440 


54 


1 

ol 


1 A 


7.750 


1,349 


74 


4 


13,330 


1,894 


11 


7 


14,520 


2,910 


11 


4 


10,000 


1,261 


75 


5 


290 


294 


51 


20 


19,990 


4,462 


11 


4 


630 


29 


64 


18 


3,650 


459 


74 


8 


9,070 


1,252 


74 


7 


6,500 


374 


73 


5 


7,740 


630 


11 




19,300 


5317 


11 


4 


27,500 


5,274 


11 


5 


1,000 


139 


65 


12 


3,350 


U600 


71 




19,840 


4,220 


76 


7 


3,250 


756 


70 


9 


650 


141 


63 


15 


10,076 


1,824 


72,53 


7.64 


7,561 


1,627 


6.04 


4.37 



Mean 
SD 



Estimated from Lnesco reports: typically four years of schooling. 
Note: The six national indicators were combined with equal weight to produce the Composite 
Development Index (CDI) for each countr>'. 
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In order to provide a framework within which to judge more fairiv the results 
of this survey, the average scores for each participatina country are presented 
alongside a measure of cenain relevant indicators of national development. 
Table 2. 1 h.sts a .set of six indicators chosen to highlight national differences in 
three kmds of resources - economic, health and literacx - plus a Composite 
Development Index (CDI) formed by aggregating all six indicators. These three 
basic dimensions of national development were chosen because they are 
believed to provide indirect suppon to the promotion of literacy levels in 
schools, over and above the quality of their teaching programs. Thev are readily 
available indicators, rea- onably accurate, generally stable over time and rel'- 
evant tor interpreting the progress of literacy in each country. 

Thus, nations with a high GNP can afford to pay more for quality teachers, 
tor teacher training, for advisory services, and for better resources in schools! 
The actual expenditure on education per student is another indicator of both 
national wealth and the value placed on education by the community. Indices 
such as life expectancy and the percentage of low birth-weight infants are 
indirect measures of general physical health. The inclusion of health measures 
IS based on the a.ssumption that students* schooling, if it is to be .successful, will 
not be handicapped by malnutrition, inadequate health services, and frequent 
absences from school, on the part of .students or teachers. The number of 
newspapers in circulation per 1000 population and the reported percentage of 
adult literacy are both indirect measures of the value placed on literacy by the 
general population. Countries with low status on the CDI are systematically 
disadvantaged on these criteria, and thus are potentially less able to achieve hiah 
levels of literacy on the tests used in this survey. 

The decision to combine these indicators into a single index of development 
was assisted by recent precedents and by the very high correlation observed 
among them in this survey (.see Appendix F). The three underlying dimensions 
are similar to those reported in the recent Human Development Index (HDD 
produced by a UNDP team (1991). This index was based on GDP, Life 
Expectancy and Adult Literacy Level. The addition of three more indice.s, each 
of which was highly correlated with one of the HDI dimensions, was believed 
to strengthen the statistical base of the CDI. and to reduce the effects of minor 
anomalies due to differences in methods of reporting the HDI indicators. The 
corre ation between the CDI u.sed in the survey and the HDI for 32 systems was 
0. 89. The development of the CDI makes possible a fairer interpretation of the 
oifferences between nations in their reading literacy standards, as reported in 
this booklet. 



CHAPTER THREE 



HOW WELL DO NINE-YEAR-OLDS READ 
AROUND THE WORLD? 

General Comments 
What scores are used for reporting? 

This chapter presents the achievement scores for Population A students in the 
27 countries which participated at this age level. Before these scores are given, 
however, it is appropriate to explain briefly what they mean. 

In Table 1 . 1 it was seen that the Population A Narrative domain had 22 items. 
The Rasch scaling method was used to create an international scale which has 
a mean of 500 and a standard deviation of 100. All Narrative scores for the 9- 
year-old samples are reported on this scale. The same procedure was used for 
reporting student scores in each domain and at each age level. Thus, there are 
three separate domain scales for each age level used for reporting in this booklet. 
There is no particular significance in a scale which centers on 500 points. Like 
temperature scales which can be reported in Fahrenheit or Centigrade units, the 
reading literacy scores could just as easily have been placed on scales with other 
means and standard deviations. 

Students who scored close to the international mean score of 500 were 
typically those who responded correctly to items which were of intermediate 
difficulty. For instance, they responded correctly to items which required 
processes like the following: 

Narrative scale 

Can read a story about a shark which befriends a family of sardines and say 
why the shark was swimming alone. 

Can read a short fable about an elephant which was bothering a family of 
birds and say how the mother bird got the elephant to go away. 

Expository scale 

Can read a short passage about quicksand, and respond correctly to a 
question which asks how to recognize quicksand. 
Can read a description of the walrus and say how long it lives as stated in 
the passage. 
Documents scale 

Can study a simple map and identify the place south of point x. 

Can study a school timetable and work out which was the third lesson on 

Thursday. 

Students who earned scores over 600 were able to respond correctly to very 
difficult items requiring the ability to read long complex stories or complicated 
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figures and to make inferences about major themes, the motives of characters, 
or unusual relationships in the information given. 

Students who scored below 400 had very limited reading ability. Typically 
they could respond correctly only on short simple passages where the items 
required limited processing or the answer was clearly stated in the passage. 

More detailed information about the meaning of the scores will be presented 
in later publications. Further information about the rationale for the scores used 
in this booklet is provided in Appendix C. 

Example: Finland Narrative scores 



International Mean 

Jy Finnish Mean 




/ / Standard \ \ 




Bonfcrroni 
Confidence Interval 



Interpreting the figures 

Figures 3.1, 3.2, and 3.3 (at the end of this chapter) present the Population A 
reading literacy achievement results. In order to explain how to read Figures 3. 1 
to 3.3, an example is given above. It shows the results of Finland for the 
Narrative domain and is the same as that given on the first line of Figure 3. 1 . The 
left-hand vertical line represents the first percentile. For Finland this is 353. 
This is the score below which one percent of the sample scores. The dot at the 
left hand side is the score for the fifth percentile. This is the score (420) below 
which five percent of the sample of Finland performed. The next vertical line 
indicates the tenth percentile point, i.e., the score (466) below which ten percent 
of the sample scored. The 25th percentile (508) follows. The heavy black bar (at 
5G0) is the international mean (average) score for all students in the survey. In 
the middle of the distribution, the long thin bar (at 568) is the mean score for the 
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Finnish sample on the Narrative domain items. Moving further to the right along 
the araph. the next vertical line is the 75th percentile (602). then the 90th 
percentile (649). the dot represents the 95th percentile (681 ). and the final bar 
the 99th percentile (708). i.e.. the score below which 99 percent of the students 
in the Finland sample performed. 

The middle section of the graph has been enlarged so that its parts can be ■ 
seen. On either side of the Finnish mean there are two shaded areas. The darker 
(inner) area represents the standard error of sampling, i.e.. the interval within 
which the actual average score lies (with 95 percent confidence ). This interval 
extends plus or minus 6.0 (562-574) points from the mean. The lighter (outer) 
shaded area represents the Bonferroni confidence interval (558-579). The 
Bonfen-oni sianificance testing procedure is recommended when multiple 
comparisons are being made. In brief, it is a method of adjusting significance 
levels so that the probability of falsely rejecting one or more null hypotheses 
when many comparisons are made is kept to a fixed level. 

Figure ^ 4 shows the same means again, presented in the order ot each 
nation's Composite Developmental Index (CDI). The CDl score in this figure 
is the scaled score expected on the basis of the CDI. Thus. Switzerland, with 
a high CDI value of 4.29 (see Table 2.1) produces a high expected overall 
averace score of 541 . The actual mean domain scores for Switzerland, shown 
in 'figure 3.4. are 506. 507 and 522 for Nan-ative. Expository and Documents 
scale"'s respectively. The tlgure shows which countries scored above and below 
the CDI prediction in each domain, and by how much. 

A study of Fiaure 3.4 shows that the profile (perfonnance on each of the 
domains) of most systems of education is relatively homogeneous across the 
three domains. If Population A students in a country are reading well according 
to the Narrative Scale, they are likely to be reading well in the other two scales 
also Prominent exceptions to the rule of a homogeneous profile are Denmark. 
Hong Kong and the two Germanys. which showed greater strength on the 
Documents Scale, and Greece and Indonesia, whose students were stronger on 
Narrative and Expository reading. While individual students within countries 
may have irregular profiles across the three types of reading literacy, the 
con-elations between national means were very high at both age levels. Hence, 
there is justification for combining the domain scores for some purposes. 

Table 3.1 presents the actual mean scores for all countries by separate 
domains and bv an overall average of the three domain scores. It can be seen that 
the differences between most of the developed countries are not vcrN' great. 
Thus. 15 countries showed overall mean scaled scores between 500 and .^40. 
There is a clustering of many education systems at this point on the scale. 
Mevertheless. there ^were a few countries which showed consistently high 
patterns of achievement across all domains at both age levels. Likewise, a tew 
countries showed consistently low levels of literacy on each domain at both age 
levels There is a stability in Uiese patterns which is reflected in a high 
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correlation between the mean national scores at the two age levels (0.83), There 
are real, stable differences in reading literacy levels between nations. Such 
differences give rise to interesting questions for research. 

A few countries in Population A tested many underage or overage children. 
Thus, the average age for Canada ( BC) was 8,9 years, whereas the average age 



Table 3.1. Mean student ability scores (with standard errors of sampling) for all 
domains, arranged in order of overall achievement: Population A 







Mean 


Overall 


t 
1 


Narrative 


Expository 


Documents 


Country 


Grade 


Age 


Mean 


Y 

SD 


Mean 


SD 


Mean SD 


Mean 


SD 




tested 


(in 


(s.e.) 




(s.e.) 




(s.e.) 




(s.e.) 








years) 


















Finland 


3 


9.7 


569 


70 


568 (3:0) 


83 


569 (3.1) 


81 


569 (4.0) 


88 


United 


4 


10.0 


547 


74 


553 (3.1) 


96 


538 (2.6) 


80 


550(2.7) 


81 


States 




















106 


Sv/eden 


3 


9.3 


539 


94 


536 (2.6) 


100 


542 (2.7) 


112 


539(3.2) 


France 


4 


10.1 


531 


74 






533 (4.1) 


84 


527 (3 O'i 


81 


Italy 


4 


9.9 


529 


80 


533 (4.0) 


88 


538 (4.0) 


95 


517(4.9) 


92 


New 


5 


10.0 


528 


86 


534(3.5) 


102 


531 (3.1) 


93 


521 (3,3) 


92 


Zealand 






















Norway 


3 


9.8 


524 


91 


525 (2.8) 


102 


528 (2.3) 


103 


519(2.8) 


101 


Icelandt 


3 


9.8 




85 


518(0.0) 


95 


517(0.0) 


101 


519(0.0) 


91 


Hong Kong 


4 


10.0 




71 


494 (4.1) 


87 


503 (3,4) 


72 


554(4.2) 


89 


Singapore 


3 


9.3 


515 


72 


521 (1.1) 


91 


519(1.0) 


75 


504(1.0) 


78 


Switzerland 


3 


9.7 


511 


83 


506 (2.6) 


92 


507 (2.7) 


100 


522(2.8) 


96 


Ireland 


4 


9.3 


509 


79 


518(3.7) 


94 


514(3.2) 


89 


495 (3.8) 


84 


Belgiuni/Fr 


4 


9.8 


507 


77 


510(3.3) 


92 


505 (2.8) 


85 


506(3.5) 


88 


Greece 


4 


9.3 


504 


75 


514(3.8) 


88 


511 (3.6) 


85 


488 (3.8) 


85 


Spain 


4 


10.0 


504 


78 


497 (2.4) 


86 


505 (2.3) 


92 


509 (2.7) 


89 


Germany/W 


3 


9.4 


503 


84 


491 (2.8) 


93 


497 (2.9) 


104 


520(3.2) 


94 


Canada/BC 


3 


8.9 


500 


80 


502 (3.5) 


96 


499(2.7) 


94 


500(2.8) 


86 


Germany/E 


3 


9.5 


499 


84 


482 (4.2) 


93 


493 (3.6) 


103 


522 (5.0) 


96 


Hungary 


3 


9.3 


499 


78 


496(2.9) 


80 


493 (3,1) 


101 


509 (3.5) 


89 


Slovenia 


3 


9.7 


498 


78 


502 (2.7) 


94 


489 (2.5) 


93 


503 (2.5) 


82 


Netherlands 


3 


9.2 


485 


73 


494 (3.3) 


85 


480 (3,4) 


87 


481 (3.9) 


82 


Cyprus 


4 


9.8 


481 


77 


492 (2.4) 


92 


475 (2.3) 


91 


476(2.1) 


81 


Portugal 


4 


10.4 


478 


74 


483 (3.3) 


81 


480 (3.0) 


84 


471 (4.5) 


92 


Denmark 


3 


9.8 


475 


IP 


463 (3.4) 


119 


467 (3.5) 


127 


496 (3.6) 


125 


Trinidad/ 


4 


9.6 


451 


79 


455 (3.6) 


91 


458 (3.4) 


93 


440(3.3) 


82 


Tobago 
Indonesia 


4 


10.8 


394 


59 


402 (2.8) 


66 


411(3.2) 


77 


369 (3.0) 


66 


Venezuela 


4 


10.1 


383 


74 


378 (3.2) 


86 


396(3.3) 


91 


374 (3.7) 


84 



•:■ Iceland tested all students, therefore no standard error was calculated, 
s.o. = I standard error of sampling 



in all countries tested was close to 9.7 years. Likewise. Franck, Pc^rti'gau 
Indonhsia and Venezuela had large numbers of students over ten years of age. 
As these countries were ^outliers* in this respect, a fair comparison of their 
performance levels calls for some adjustment. However, there is no ideal 
method of arriving at such an adjustment from a cross-sectional survey. (See 
Appendix E on age adjustments,) 
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Not only are mean scores of interest, but much can be gleaned about the 
performance of the top and bottom 25 percent of students. For example, a 
perusal of Figure 3.1 (Narrative domain) would indicate that the top 25 percent 
in the United States does particularly well, whereas in Hungary these students 
would appear to perform less well. The same can be said about Portugal. It is 
also clear from Figure 3. 1 that the bottom 25 percent in Sweden, Norway and 
Canada (BC) perform less well than the bottom 25 percent in most other 
countries. 

High Scoring Countries 

It is clear from Figures 3.1 to 3.4 and from Table 3.1 that the 9-year-olds of 
Finland are the best readers on all three dimensions of reading literacy assessed 
in this survey with the highest average scores for each domain (Narrative 568, 
Expository 569, Documents 569). These scores are more than half a standard 
deviation above the international mean, and the average score is 20 points above 
the average score of the next country. Furthermore, Finnish students performed 
the best or second best on 70 percent of the 60 test items, and only 1 percent of 
students scored below a raw score of 25 percent, which is a crude but useful 
external indication of non-reading status on items which could be guessed 
correctly 25 percent of the time. What is most remarkable about this result is that 
children in Finland do not begin formal schooling until age seven, whereas in 
most of the remaining countries students begin to read at age six or younger. 
There is clearly something to be learned from the impressive way in which 
Finnish students acquire literacy - from their policies, their methods of instruc- 
tion, and their attitudes to reading. This result also raises afresh the question of 
whether the consistent sound-symbol relationship of the Finnish language is a 
key factor in learning to read. The Finnish orthography is a highly regular 
system, which could well facilitate a child' s passage into literacy (Kyostio 1 980, 
Oney and Goldman 1984). 

A comparison with the CDI (Figure 3.4) shows that Finland exceeded the 
average score that would be predicted by the nation's social and economic 
circumstances by a substantial margin (average, 39 points). These results are 
compatible with the Finnish performance on the Population B test. All the 
indications are consistent and stable. Finnish students are clearly very good 
readers by age nine. 

The United States also performed well above expectation (30 points above 
the CDI prediction) and had the second best outcome in the Narrative and 
Expository domains (553 and 538 respectively). The average score for reading 
literacy was consistent with the earlier lEA reading survey of 15 countries 
(Thorndike 1973). A close analysis of the American students' distribution 
shows consistently high performance on all items, and less than two percent of 
students scoring below the chance level cutoff point of 25 percent. Students in 
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the American sample are relatively strong in literacy, in spite of reading in a 
language with an irregular orthography. 

With a very high status on the GDI, the Swedish students were expected to 
achieve well. The results confirm this prediction with average scores on each 
domain close to 540 points (536, 542, 539). As in the other Scandinavian 
countries, they enjoy small classes and well-trained teachers but, like Finland, 
their students have been attending school only since age seven. As in the 1970 
lEA survey and the pilot study of 1990, Swedish students showed a consistently 
high level of performance at this age level and have achieved close to their high 
GDI prediction. They too must have some lessons for reading educators in other 
countries. 

France, New Zealand and Italy have very similar profiles to that of Sweden. 
The absence of private schools in the French sample has an unknown influence 
on these results as well as on the GDI comparisons, but the state schools 
achieved above expectation by 21 points overall. The number below chance 
level was less than two percent. 

New Zealand students also showed high standards in all domains and, 
relative to their more modest economic and social circumstances, were well 
above prediction (28 points). New Zealand reading methods have enjoyed a 
notable reputation internationally in view of their students' strong performance 
in the earlier lEA surveys of reading and literature. The fact that New Zealand 
students begin school at age five could well give them a favorable start in a 
survey of 9-year-olds, as these students were tested in a higher grade than were 
many others. However, the lack of relationship between the age of beginning 
instruction and performance is already becoming clear and will be examined 
more systematically later. 

The 9-year-olds of Italy scored at a similar level to New Zealand and their 
results were certainly consistent with a high level of performance in the 
Thomdike survey. Interestingly, they too have the advantage of a language 
which is phonetically very regulai*, which may facilitate the acquisition of 
literacy. 

Other countries whose students scored above the international mean were 
Norway, Iceland and Hong Kong, all with overall average scores close to 520 
points. Hong Kong's results were higher than anticipated, as its level of 
economic and social development is more modest than that of many of the 
countries in the survey, and their students were acquiring literacy in Ghinese, a 
language with an ideographic script widely believed to present more difficulties 
for its students than the alphabetic script. The profile for Hong Kong students 
is intriguing, as they scored very high in the Documents scale (554, second 
highest), but only at or belov/ ^he international mean in the Narrative (494) and 
Expository (503) domains. This pattern was strengthened by an analysis of their 
chance level scores. Less than one percent of Hong Kong 9-year-olds fell below 
25 percent in the Documents scale, while over six percent did so on the Narrative 
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scale. Variations in cultural emphasis and test taking traditions may account for 
these deviations. 

Norway and Iceland had very similar CDI predictions, very similar domain 
score levels (Norway 525, 528, 519; Iceland 518, 517, 519) and very similar 
percentages of low scoring students. In both countries, formal instruction starts 
at age seven, the languages have similar degrees of phonetic regularity and they 
report similarly low numbers of hours of instruction per year. In both cases the 
students achieved at levels a little below what their high CDI status would 
predict. 

Canada (BC) students start school at six, but were tested in Grade 3, so their 
sample was neariy 10 months younger than the international mean age. How- 
ever, even without an adjustment for age their students achieved close to the 
overall average of 9-year-olds, indicating a high level of literacy in the junior 
classes of British Columbia. Switzerland also produced scores above the 
international average in all domains, and a particularly strong average score in 
the Documents scale (522). 

Other countries well above expectation 

Three other countries with mean achievement levels well above the levels 
predicted by their economic and social circumstances were Singapore, Hun- 
gary, and Spain. 

The case of Singapore is particularly interesting as it is an example of a 
country where the language of instruction, and of testing, is different from that 
of the home for over 70 percent of the students. Singapore children begin 
reading instruction in English at age six, yet most of them arrive at school 
speaking only their native Chinese or Malay or Tamil languages. The fact that 
the Singapore students scored 521 and 519 in the Narrative and Expository 
domains must challenge the conventional wisdom that students should learn to 
read first in the language of the home. Like the students of Hong Kong, they 
showed very low numbers of students scoring below chance level on Documents 
( 1 .6 percent), but considerably more on Narrative (5.9 percent). The Singapore 
education system must have some lessons for those schools and systems where 
students are acquiring literacy in a non-native language. 

Two European countries with mean achievement levels above expectation 
were Hungary and Spain. Again one could point to the fact that, like Finland, 
both countries have a language which enjoys a high degree of regularity between 
grapheme and phoneme. This matter is examined more thoroughly in Chapter 
Five. 

Countries With Relatively Low Achievement 

As noted earlier, all the developing countries tended to have lower achievement 
levels than the industrialized nations. In general their economic position is 
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weaker and they lack long-standing literacy traditions. Venezuelan and Indo- 
nesian students had similarly low means in each subtest (378, 396, 374 and 402, 
411, 369 respectively, or 35 percent to 40 percent correct). Nearly a third of the 
students in each country scored at chance levels or below, indicating virtual non- 
reader status. The results of the Word Recognition Test confirmed these 
findings. Moreover, the mean ages of the students sampled werehigher than in 
the other systems (10.7 and 10.8 years old, respectively). However, a closer 
analysis shows that the highest 25 percent of students in each country had more 
than half the items correct in each domain. It should be noted that for nearly 80 
percent ^ Indonesian students the national language is their second or third 
language 

AnotL country with a low achievement level was Trinidad and Tobago, 
with scaled score averages close to 450 (near 50 percent) in each domain. Nearly 
15 percent of these 9-year-olds scored below 25 percent, yet they have been in 
school since age five. Government resources for education are relatively 
meager, but literacy levels do not reflect the cunent social and economic 
conditions as judged by the performance of 9-'year-olds elsewhere. The average 
score overall was 26 points below CDI prediction. 

Of the remaining countries, results in Cyprus, Portugal and Denmark, with 
average scores below the international mean in each domain, revealed many 
struggling readers at this age. The discrepancy between the CDI prediction and 
the measured achievement level for Denmark was surprising (-41 points) and 
out of line with that of the Danish 14-year-olds. A large number of Danish 9- 
year-olds failed to finish the tests, and as many as 17 percent scored below 
chance level. Danish students also attained low average scores and low comple- 
tion rates on the Word Recognition Test. Among the possible reasons for these 
results are the following: Danish students begin reading instruction only at age 
seven and at age nine they are quite unaccustomed to taking formal tests, 
according to the teachers' questionnaire responses. It was noted that many 
student showed a reluctance to answer when they were unsure. 

The children of Cyprus and Portugal begin reading at ages five and six 
respectively, bat both countries have a relatively low resource base for funding 
schools, below average adult literacy rates, and low preschool participation 
rates. Both had achievement means very close to their CDI expectation, which 
was below 500. The Netherlands' result was also lower than anticipated but 
would be in line with prediction if an adjustment were made for the fact that the 
Dutch sample was considerably under age. (Such an adjustment is attempted in 
Appendix E.) 
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CHAPTER FOUR 

HOW WELL DO FOURTEEN-YEAR-OLDS READ 
AROUND THE WORLD? 

General Comments 

As in Population A. each of the domain scales for Population B has a mean of 
50() and a standard deviation of 100. However, the reading ability required to 
gain a score of 500 is greater than that required for a score of 500 on the 
Population A scales. 

Students who scored approximately 500 on the Population B scales were 
typically able to respond correctly to items which required abilities such as the 
following: 

Narrative scale 

Given a story about a magician whose audience suspected him ot having 
many things' up his sleeve, students can infer the magician's feelings. 
Given a story about a young man who killed a fox he came upon unexpect- 
edly, students can say what the writer's message was. 
Expositor^- scale 

Given a lengthy magazine article on the development of the laser, students 
can identify what was its most spectacular success. 
Given a descriptive passage about a family of marmots, students can infer 
why the grass in the area is healthy. 
Documents scale 

Given a chart listing weather conditions in 40 cities, students can determme 
what was the low temperature in city X. 

Given a map. students can use its legend to identify what resources are 
found in region X. 

At the upper levels, students who gained scores over 600 were able to 
comprehend long complex passages with a heavy vocabulary load well enough 
to respond con-cctl v to questions which require subtle inferences or to integrate 
information from different parts of the passage. Students who scored below the 
4(X) level were able to read short to medium length passages well enough to 
respond con-ectly to questions about facts given in the passage or to make easy 

inferences about them. 

Fieures 4. 1 to 4.3 present the achievement results for each domam in the 
Popufation B tests, an-angod in order of overall performance level, and Figure 
4 4 presents the same results, airanged in order of the countries* Composite 
Developmental Index (GDI). Table 4.1 presents the average scores. Nigi-.ri.\. 
Tumi \nd and Zimbabwe had response rates below 80 percent, and are marked 
with asterisks. Also. FRANCt. Portigai. and Vi-;ne7X-ula had considerably 
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overage samples. Adjustments for age would reduce their scores by 15 to 20 
points, and raise those of Canada (BC) by a similar margin. Caution should be 
exercised in judging the performance levels of these seven countries. 



Table 4.1, 



Country 



Mean student ability scores (with standard errors of sampling) for 
all domains arranged in order of overall achievement: Population B. 





Mean 


Overall 


Narrative 


Expository 


U 1 i 1 V i 1 Ih^ 


Grade 


age 


Mean 


SD 


Mean SD 


Mean SD 




tested 


(in 


(s.e.) 




(s.e.) 




(s.e.) 




vS.e.j 




years) 
















8 


14.7 


560 


65 


559 (2.8) 


84 


541 (2.2) 


71 


580(2.5) 82 


9 


15.4 


549 


68 


556 (4.2) 


86 


546 (4.3) 


84 


544(4.2) 77 


8 


14.8 


546 


80 


556 (2.6) 


93 


533 (2.4) 


91 


550(2.4) 90 


10 


15.0 


545 


92 


547 (5.7) 


104 


535 (5.7) 


105 


552(5.3) 98 


8 


14.1 


536 


73 


530 (3.1) 


81 


536(3.6) 


91 


542(3.2) 82 


8 


14.8 


536 


78 




91 


548 (0.0) 


100 


509(0.0) 77 


Q 
O 




536 


74 


534 (3.4) 


90 


525 (3.2) 


87 


549(3.0) 82 


9 


15.2 


535 


64 


509 (3.7) 


72 


540 (3.8) 


79 


557(3.8) 76 


9 


15.0 


535 


85 


(4 9^ 


98 


539 (5.6) 


107 


528(4.0) 84 


8 


14.4 


534 


66 


530(1.1) 


73 


539 (1.2) 


82 


533(1.1) 74 


8 


14.7 


532 


63 


534 (2.6) 


76 


525 (2.2) 


73 


537(2.2) 74 


8 


14.4 


526 


73 


512(3.9) 


90 


523 (3.5) 


87 


543(2.9) 81 


8 


14.8 


525 


77 


517(2.0) 


83 


524 (2.2) 


94 


532(2.1) 88 


9 


15.6 


523 


60 


523 (2.5) 


71 


523 (3.4) 


79 


523 (3.4) 67 


8 


13.9 


522 


81 


526(3.1) 


94 


516(3.1) 


97 


522(2.7) 88 


8 


14.6 


522 


78 


514(4.9) 


95 


521 (4.5) 


92 


532(3.9) 82 


8 


14.8 


516 


71 


515(2.1) 


76 


520 (2.4) 


86 


512(2.4) 82 


8 


14.1 


515 


73 


520(3.6) 


88 


524 (3.2) 


85 


501(3.3) 78 


8 


14.3 


514 


76 


506 (4.8) 


88 


503 (4.7) 


83 


533 (5.3) 90 


9 


14.5 


511 


81 


510(5.3) 


93 


505 (5.3) 


94 


518(4.9) 90 


9 


14.4 


509 


65 


526(2.9) 


75 


508 (3.1) 


84 


493(2.6) 69 


9 


14.8 


497 


73 


516(2.2) 


82 


492 (2.4) 


91 


482(2.0) 74 


8 


14.2 


490 


65 


500(3.0) 


84 


495 (2.6) 


79 


475(2.0) 64 


8 


14.3 


481 


78 


484(5.1) 


95 


477 (4.8) 


89 


483 (4.7) 82 


9 


14.4 


479 


87 


482(1.7) 


96 


485(1.8) 


100 


472(1.7) 92 


9 


15.2 


477 


79 


468 (6.6) 


88 


486(5.9) 


87 


478(6.2) 88 


8 


14.5 


430 


65 


421 (3.6) 


71 


439 (4.1) 


78 


430(3.9) 72 


9 


15.5 


417 


61 


407 (2.9) 


67 


433 (3.3) 


80 


412(3.0) 70 


9 


15.3 


401 


65 


402 ("-) 


69 


406 (-) 


73 


394 (— ) 81 


9 


15.5 


372 


60 


367 (3.3) 


64 


374 (3.6) 


70 


373(4.6) 83 


7 


\4.1 


330 


43 


340(1.6) 


53 


339(1.9) 


58 


312(2.4) 69 



Finland 
France 
Sweden 
New Zealand 
Hungary 
Iceland 
Switzerland 
Hong Kong 
United States 
Singapore 
Slovenia 
Gcrmany/E 
Denn)ark 
Portugal 
Canada/BC 
Germany/W 
Norway 
Italy 

Netherlands 

Ireland 

Greece 

Cyprus 

Spain 

Belgiunn/Fr 

Trinidad/ 

Tobago 

Thailand* 

Philippines 

Venezuela 

Nigeria!* 

Zimbabwe* 

Botswana 



r Insufficient data to calculate the Design Effect. 

* Sampling response rates of schools was below 80 percent. 

s.e. = 1 standard error of sampling 



At the Population B level there is again a group of countries in the 500 to 540 
ranee whose bet\veen-counir>' differences are remarkably similar to those of 
Population A. For those countries participating in both populations the coirela- 
tion between average scores for the two age groups 'iv 0.83. While the differences 
between these countries are often not statistically significant (when the conser- 
vative Bonferroni Tests of Significance are ajjpHed), the relative performance 
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levels are surprisingly stable across surveys taken at different ages and at 
different times. 

High Achieving Countries: Population B 

Once again, students of Finland achieved the highest average score of all 
countries in the Narrative and Documents domains, although they dropped a 
little in the Expository domain. A perusal of the item analysis results showed that 
they had the highest or second highest percentage of students with correct 
answers on approximately half of the items over all tests. There is no doubt that 
the Finnish students have maintained the position of their younger counterparts 
as the most competent readers of all countries in the survey. Their average score 
was also 18 points above expectation, based on their CDI. 

Very high performance was shown also by the students of France with the 
second highest average score in the Narrative (556) and Expository (546) 
domains, and sixth highest in Documents (544), It should be remembered that 
this resuh applies only to French public schools (i.e., 75 percent of the total 
population of 14-year-olds). Moreover, they had a mean age of 15 years 5 
months (9 months above the international mean age). Again, the average level 
achieved by the French sample was higher by 23 points than expected on the 
basis of the CDI. 

Sweden and New Zealand also showed very high performance levels. 
Sweden's result, like that of Finland, is notable because it was achieved by 
students with fewer years at school and fewer hours of instruction than most. 
New Zealand students scored above their expected average score by 32 points, 
though not as well as in the 1970 survey (Thomdike 1973). 

Switzerland's 14-year-olds had an excellent result on the Documents scale 
(549), but were less successful in the Expository domain (525). Two other 
countries showing high performance, relative to expectation and age were 
Hungary and Slovenia. On the CDI, Hungary ranks only 22nd, but their 
students' reading literacy means were in the top nine for each domain. The 
average score was 57 points above prediction. Hungarian students have raised 
their performance level since the last lEA Reading Study (Thomdike 1973) and 
now read relatively well in all areas. At a similar level was Slovenia (534, 525, 
537), which exceeded expectation by 32 points. Icelandic students showed an 
unusually strong performance on the Expository scale (548 the highest mean), 
but were less successful in their level of Document literacy (509). 

Singapore students, like their younger counterparts, performed very well in 
the Narrative and Expository domains (530 and 539 respectively). Again, the 
notable point to remember about this result is that Singapore 14-year-olds have 
English as their medium of instruction and testing from the first year of school, 
yet it is the home language of only 26 percent of the sample. As at the 9-year- 
old level, Singapore students achieved well above expectation (43 points) based 
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on their economic and social circumstances and on linguistic considerations. 
They were also below the international average in age. 

Hong Kong students showed an impressive profile in the Document and 
Expository scales (557, 540) but dropped quite steeply in the Narrative section 
(509), Their unusual profile across domains was similar to that of the 9-year- 
olds, suggesting that it is not unique to one set of reading exercises. However, 
it should be noted that the Hong Kong sample, was nearly five months older than 
the international mean age. It is also worthy of comment that Hong Kong and 
Singapore were among the top five countries in the extent to which they 
achieved above expectation, relative to their CDI prediction. While both 
countries are populated largely by Chinese students, their schooling is con- 
ducted in languages that could not be more different. 

Also listed in this group of high-achieving countries was the United States, 
with domain scores that clustered around 535, and an overall perfoimance level 
very close to the level expected by their level of economic and social develop- 
ment. It will be noted that the American students performed considerably better 
at the 9-year-old level relative to the other participating countries than at the 14- 
year-old level. 

Countries with relatively low achievement 

As at the 9-year-old level, the 14-year-olds in developing countries fared less 
well in their levels of reading literacy in all domains. Students in Botswana, 
Nigeria and Zimbabwe scored at or below 400 points, and each had large 
numbers of students below the chance level mark of 25 percent. In all three 
cases, the majority of the students were tested in a non-native language, and the 
resource levels and traditions of literacy in each case were less than favorable. 

The 14-year-olds in Venezuela and the Philippines performed somewhat 
better with their literacy tasks, showing average scores of 417 (407, 433, 412) 
and 430 (421, 439, 430) respectively, but the Venezuelan achievement level 
was still well below expectation. Furthermore, only 72 percent of their 14-year- 
olds were still in school, Thailand had relatively higher means (468, 486, 478), 
but it has only 33 percent of this age group in school. Trinidad and Tobago 
students achieved at a much higher level at age fourteen than at age nine and had 
average scores within 20 points of the international average, almost up to their 
predicted level across domains. 

Among the European countries results of the students in Belgium (Fr) and 
the Netherlands were lower than expected. They fell below CDI prediction by 
39 and 17 points respectively. Both countries had large numbers of students 
younger than 14.5 years at the time of testing, but an adjustment for age would 
only raise their estimated scores by approximately ten points. Portugal showed 
much better performance levels at age fourteen than at age nine, but it should be 
noted that their students were 15.6 years old at the time of testing. 
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Distribution of Scores 

Again, the reader may well wish to peruse Figures 4.1, 4.2 and 4.3 for 
performance at different parts of the score distributions. For instance, the range 
of scores for Portugal and Singapore in each domain is naiTOw; for New 
Zealand the scores are widely distributed. It can be seen that the top five percent 
of students are ver>' similar in their performance levels in Narrative for the first 
25 countries, but more variable in the other two domains. Also the contrast in 
performance levels between the developing countries and the remaining coun- 
tries is apparent at all points in the distribution for each domain. 

A study of Figure 4.4 reveals other trends. The students of Portugal 
produced the same mean score in each domain; those of Finland and Hong Kong 
clear differences between domains. Students of France, New Zealand, Singapore, 
Hungary and Portugal achieved consistently well above the scores predicted 
by their CDI; those of Norway, Belgium (Fr), Zimbabwe and Botswana 
performed consistently below theirs. 
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CHAPTER FIVE 



HOW DO HIGH-ACHffiVING COUNTRffiS DIFFER 
FROM LOW-ACHIEVING COUNTRIES? 

A question often asked of those who conduct cross-national studies is: What 
bringsabout these differences in achievement levels between nations? Why, for 
instance did Finland's students achieve so well, relative to other nation's 
standards ? What brought about the unusual profile of results in Hong Kong? Are 
such differences caused by educational policies or are they attributable to a 
variety of wider cultural and economic factors? What can be learned from a 
scrutiny of the results so far? Correlation studies cannot reveal causes . However, 
comparison between high- and low-scoring countries can identify factors which 
deserve closer study, and those which are unlikely to be important. 
To pursue this question, the countries were arranged in order of average 
achievement scores, across all domains, and relevant indicators of hypothesized 
causes and correlates of high achievement were collected from the Student, 
Teacher and School Principal Questionnaires, the National Case Study Ques- 
tionnaire and from other sources such as Unesco and Worid Bank Reports. 
These indicators were grouped into two categories for closer analysis. 

1. General: Those which are indicative of the general level of social and 
economic development in each country, and largely beyond the control of 
educators; and 

2. Educational: Those which are indicators of educational policies, and 
practices. 

General Influences on School 
and Community Literacy Levels 

The rationale for each of the chosen variables is given briefly. Many of these 
general influences are identical to those included in the CDI. 

1 . GNP Per Capita (US$1 Wealthy nations can afford to put more resources 
into education. 

2. Adult Literacy, High levels of adult literacy in a society suggest a greater 
societal pressure to acquire literacy in the next generation. 

3. Newspaper Circulation (per 1000 people). More newspapers are a sign of 
the community's wish to keep abreast of worid events by means of reading. 
Agam, this reflects a societal pressure to read. 

4. Public Library Books (per 1000 people). An abundance of books in 
libraries is another index of the extent to which citizens emphasize reading 
as a pursuit, and provide opportunities for young people to read. 
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5. Economic Status of Teachers. Where teachers are accorded high status, the 
profession is more likely to attract bright young people into teaching, which 

. should in turn enhance the quality of education. This factor was estimated 
by comparing average teacher salaries with those of police, nurses and bus- 
drivers, as estimated by National Research Coordinators. 

6. Expenditure on Education, Per Student (US$). The amount spent on 
schooling is an index of the value placed on children's education in the 
society, as well as another index of wealth. 

7. Language Homogeneity of Sample, If there are many students whose home 
language is different from that of the school, the achievement levels in 
literacy in that language would be expected to be lower. 

8. Low Birth Weight Infants, The percentage of infants bom in the official Low 
Birth Weight category is an indicator of the health and welfare of mothers 
and children, and thus an indirect measure of the learning potential of 
students. 

9. Life Expectancy. This is another index of the general health of the citizens 
of the country, and indirectly a probable influence on the effort which 
children can put into learning. 

Table 5. 1 lists the 3 1 systems for which data were available in Population B 
in order of mean scaled score across domains and the nine potential influences 
listed above. Based on available statistics, the countries were compared on each 
variable. Those that were in the top quarter of countries on a variable were 
recorded with a diamond; those in the second highest quarter of countries on that 
variable were recorded with a circle. The horizontal lines show how the 
countries cluster by score after taking into account the standard errors of 
sampling of those scores. For example, the seven countries with the highest 
teacher economic status arc marked with a diamond in column one, and the 
seven countries with the highest GNP per capita are marked with a diamond in 
column five. In tlie adult literacy column (column 3), all fifteen countries 
reporting 99 percent adult literacy are marked with a diamond. The variables are 
arranged from the those least related to achievement (and therefore spread 
across most countries) to those which are increasingly limited to the higher 
achieving countries. 

A study of Table 5. 1 shows that the countries whose students were judged by 
the IE A tests to be most literate at age 14 are more advantaged on these nine 
criteria than those lower down the table. Finnish and Swedish students, for 
instance, live in a rich, well educated, relatively homogeneous society with an 
abundance of literary resources, and high standards of health. The last three 
countries on the list, however, share virtually none of these apparently beneficial 
economic and social conditions. To some extent, literacy levels reflect eco- 
nomic and cultural advantages of the country as a whole. 
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Table 5.1. Relationships of national mean scores and school/commu- 
nity inaicators: Population B. 



High 
teacher 
econ. 
status 



Finland 
France 
Sweden 
New Zealand 
Switzerland 
Iceland 
Hungary 

United States 

Hong Kong 

Singapore 

Slovenia 

Germany/East 

Denmark 

Portugal 

Germany/West 

Canada/BC 

Norway 

Italy 

Netherlands 
Ireland 
Greece 
Cyprus 
Spain 

Belgium/Fr 
Trinidad/ 
Tobago 
Thailand 
Philippines 
Venezuela 
Nigeria 
Zimbabwe 
Botswana 



High 
exp, 
on 
educ. 



High 
adult 
litt 



0 
0 
0 
0 

0 
0 
0 
0 

0 
0 

0 
0 

0 
0 



High 
life 
expect. 



High Few High High High 

GNP low lang. public news- 

per binh homo- library paper 

cap. weight gencitv hldgs. circ. 



0 
0 



0 
0 
0 



0 

o 

0 



Key: 0 = In ihc lop quancr of countries on this ^ unable 

■ = In the secorJ highest quarter of countries on this variable 
t = 15 countries reported adult literacv 



Nevertheless, the relationship is by no means perfect. France. Nf.wZcaland. 
Hrsr. vRY Sincapork. and Hong Kong achieved well above expectation on these 
counts and a few wealthy European countries fell below -.heirs. There are 
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clearly some educational '*ictors which are exerting influences on achievement 
beyond these economic and cultural indicators. 

Table 5.2 shows the disparities between the ten highest and lowest scoring 
countries in Population B. Thus, among the highest ten countries, five had 
teacher economic status in the top half of all countries. In the lowest scoring ten 
countries, three did. For newspaper circulation eight of the highest scoring 
countries had high newspaper circulation and none of the ten lowest scoring 
countries had this variable. Cleariy. these nine variables can account for some 
of the differences between the achievement levels of the countries in this study. 
The correlation between national achievement means and CDI, which is based 
on six of these nine indicators is 0.76. Affluence, health and literacy pressures 
in the community are important. 

Table 5.2. Comparison of high scoring and low scoring countries on develop- 
ment indicators for Population B. 

Highest 10 Lowest 10 Difference 
countries countries 



Teacher econoniic status 
Expenditure on education 
Adult literacy 
Life expectancy 
GNP per capita 
Low birth weight 
Language homogeneity 
Public library 
Newspaper circulation 



5 3 2 

6 2 4 
8 1 7 
8 3 5 
6 1 5 

6 1 5 

7 1 6 
6 0 6 

8 0 8 



A similar pattern was observed in Population A. with slightly lower corre- 
lations. What is of greater interest to educators, however, is to investigate the 
relationship between the achievement levels and national educational policies. 
This exercise is reported first for Population A and is based on a contrast of the 
policies which are typical of high-scoring and of low-scoring countries. 

Educational Policy Indicators: Population A 

In order to investigate the intluenccs of educational factors on national achieve- 
ment levels. 21 educational policy indicators were selected. Each of these 
represented a policv which varied between countries, was readily available, was 
stable over lime and has been the subject of debate among policymakers and 
researchers in many countries. 

All the countries which participated in the Population A survey were listed 
in order of mean national achievement over all domains, ranging from age of 
beginning instruction to the frequency of formal testing. These figures were 
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obtained from National Case Study Questionnaires. Teachers' Questionnaires 
and Unesco and World Bank Reports. 

Table 5 ^ summarizes these figures by comparing the average profiles ot 
students in the ten high-^st- and lowest-scoring countries. The middle seven 
countries were not included in this analysis. The table presents the means tor 
both groups of countries, the differences between these means and the differ- 
ences expressed as a proportion of the standard deviation of all countnes on that 
variable. In this table, any proportion over 0.30. that is. three-tenths ot one 
standard deviation, is regarded as a sign of an important variable. This compan- 
son provides some indication of the importance of each vanable in reading 
literacy performance. However, in studying these figures, it must be remem- 
bered that much of the difference between these two sets of countnes is probably 
attributable to differences in economic and social development, already ob- 
served. Some of these indicators may well be signs of affluence, without 
beneficial effects on literacy levels. 

Such an analysis aives rise to another comparison, between those ten 
countries which exceeded their expected score by the most and those which fell 
most below the score expected on the basis of their CDI.' This analysis is 
presented in Table 5.4. . .• i 

What do these comparisons reveal about the importance ot these educational 
indicators in reading literacy achievement ? 

1 Startinfi ufic of reading instruction. Four countries start formal teaching of 
reading at ase five, while eicht systems start at age seven. Does the latter 
aroup showlinv disadvantage from the later start ? Not according to Table 
5 3 The ten hiahest-scorina countries began instruction at mean age ot 6.3 
years, and the\iwest ten only 5.9 years. Finland. Sweden. Norway and 
Iceland beuin instruction at age seven, yet the nine-year-olds in these tour 
countries surprisingly all fell in the top ten countries. However, all four 
countries are also in fie top group on the CDI index, so they may have done 
well recardless of the aae of beginning instruction. How does this variable 
appear^in Table 5.4. after the adjustment for differences in economic and 
social development? This time the pattern is reversed. Four of the countries 
which started at aae seven were in the lowest ten in relation to CDI 
prediction, and there is a margin of 0.45 years, favoring an earlier start. This 
represents a difference otO.69 of a standard deviation. At age nine, there 
is still some advantaue for an earlier start, but it can be said that countries 
which benin instruction in reading at age seven have largely caught up with 
the five- and six-year-old starters in reading ability by age nine. 



^ It will be remembered that the Composite Development Index (CDII .s made up ol s.x cqua ly 
ueiahtedractorsipercapitaGNP.eUucationalexpenditureperstudent.hfeexpectancy.putcnt 

knv^inh weight infants, newspaper circulation per 100. and adult literacy. 
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Table 5.3. Relative importance of selected national policy indicators in rela- 
tion to national achievement means for Population A. 



Policy 1 
indicator 

c 


rlighest 

10 
ountries 


Lowest 
10 

countries 


Proportion 
Diff/SD ofSD 


Advantage 
f or . . . 


1 Starting age of 
instruction 


6.3 yrs 


5.9 yrs 


U.4U/U.DJ 


u.oz 


Later start 


2 % Students in pre- 
school 


68J 


53.8 


14.9/31.36 


U.4o 


Preschool 
enrollment 


3 Class size in 
sample 


25.1 


24.9 


O.Z/j.72 


kjXjj 


No difference 


4 % Female 
teachers in sample 


79.7 


76.3 


J.4/ lO.JJ 


u.zu 


No difference 


5 School days per 
year 


178.9 


191.6 


12.7/19.08 


0.67 


Shorter year 


6 Hours instruction 
per week 


21.7 


20.6 


1.1/3.49 


0.32 


More hours 
instruction 


7 Phonic regularity 
of language 


2.6 


3.2 


0.6/1.21 


0.50 


Less regular 
language 


8 % Multi-graae 
classes 


20.3 


24.4 


3.1/23.2 


0.18 


No difference 


9 Years teaching 
this class 


1.57 yrs 


1.56 yrs 


0.01/0.60 


0.02 


No difference 


10 Years teacher 
education 


13.80 


12.6 


1.2/1.75 


0.69 


More education 
for teachers 


1 1 % Other language 
st)eaking teachers 


10.7 


9.8 


0.9/21.32 


0.04 


No differer ce 


1 2 Easy access to 
books in 
communitv 


74.2 


62.0 


12.2/15.2 


0.80 


Easy access to 
bot'ks 


13 Size of school 
library 


3,50 


2.56 


0.94/1.97 


0.48 


Large school 
library 


14 Large classroom 
libraries 


45.6 


22.S 


22.8/22.7 


1.00 


Large classroom 
library 


1 S Textbooks Der 
Student 


1.74 


1.59 


0.15/0,47 


0.32 


More textbooks 


1 6 Frequency borrow 

hnok^ from 

library 


3.25 


2.95 


0.30/0.5! 


0.59 


More books 
borrowed 


17 Time on leaching 
the language 


8.12 hrs 7.07 hrs 


1.05/2.41 


0.44 


More time on 
language 
teaching 


18 Frequency silent 
reading in class 


3.43 


3.36 


0.09/0.93 


0.08 


No difference 


19 Frequency 
teachers read to 
class 


2.76 


2.25 


0.51/1.18 


0.43 


More teacher 
reading to class 


20 % teachers give 
frequent reading 
tests 


38.0 


51.4 


13.4/29.0 


0.46 


Fewer tests 


21 Speed of word 
recognition 


86.9 


77.4 


9.53/6.32 


1.51 


Faster word 
recognition 
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Table 5 4 Relative imponance of selected national policy indicators for Popu- 
lation A after adjustment for economic and social conditions. 



Policy H 
indicator 

CO 


ighest Lowest 

10 10 
untries countries 


Proportion 
Diff/SD ofSD 


Advantage 
tor . . . 


I S-iirtingageof ^ 
instruction 


>.95 yrs 6.40 yrs 


U.'rJ/v/.'-rT 


0.69 


iiariy sian 


2 % Students in pre- 
school 


62.9 






0.09 


No difference 


3 Class size in 
sample 1 


27.63 


Zj. / 


j.yji J* I M 


0.69 


Larger classes 


4 % Female 1 
teachers in sample 1 


78.4 


71.8 


\J.\Jl IVJ.J 


0.40 


teachers 


5 School days per 
vcar 1 


177.6 


195.6 


18.00/19.08 


0.94 


Shorter year 


6 Hours instruction j 
per week L 


22.8 


19.7 


2.2/3.49 


0.60 


iVlOrC llOUR> 

instniction 


7 Phonic regularity 1 
of language 1 


2.78 


2.40 


0.22/1.21 


0.18 


No difference 


8 % Multi-grade 1 
clashes 1 


20.1 


20.2 


n 1/71 1 

U. uLj. i 


0.00 


No difference 


9 Years teaching | 
this class 1 


1.43 yrs 


1.69 yrs 


n OA/A ATI 


n di 


Fewer years 
with class 


10 Years teacher 1 
education 1 


13.9 yrs 


13.2 yrs 


0.7/1.75 


0.40 


More education 
for teachers 


1 1 % Other language 
speakinp teachers 1 


12.0 


10.7 


1.3/21.1 


0.06 


No difference 


1 2 Easy access to I 
books in 

mmmunity ' 


71.2 


67.3 


3.9/15.2 


0.26 


No difference 


1 3 Size of school 


3.50 


2.06 


1.70/2.34 


0.82 


Large school 
library 


library 
14 Large classroom 
libraries 


1 55.1 


43.5 


11.6/22.7 


0.51 


Larger 
classroom 
library 


15 Textbooks per 
smdent 


1.66 


1.57 


0.09/0.47 


n 1Q 


No difference 


16 Frequency borrow 
books from 
lihrarv 


3.06 


2.90 


0.16/0.51 


0.31 


More books 
borrowed 


17 Time on teaching 
the language 


7.95 hrs 


6.67 hrs 1.28/2.41 


0.53 


More time on 
language 
teaching 


18 Frequency silent 
reading in class 


3.58 


2.86 


0.72/0.92 


0.78 


More silent 
readina 


19 Frequency 
teachers read to 

nla<;s 


2.59 


2.30 


0,29/1.18 


0.25 


No difference 


20 % teachers give 
frequent reading 


46.7 


32.4 


14.30/28.98 


0.49 


More frequent 
tests 


21 Speed of word 
recognition 


86.3 


78.0 


8.3/6.3 


1.32 


Faster word 
recognition 
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Preschool enrollment rates. Countries vary considerably in the extent to 
which they offer pre-school educational ser%'ices. Several European coun- 
tries enroll the complete cohort from age four or five; others report less than 
25 percent participation at this level. 

The first analysis in Table 5.3 shows that the higher the enrollment ratio, 
the better the students" achievement at age nine. However, when adjusted 
for CDI. the pattern is reversed again, dropping to 0.09 standard deviation 
(See Table 5.4). It appears that attendance at pre-school has little effect on 
reading literacy levels at age nine, other things being equal. Of course, a 
closer analvsis may reveal important differences in the content and quality 
of the programs offered, but it is noticeable that students of Singapore and 
Greece achieved well above expectation, yet less than a third of their 
cohorts attended pre-school institutions. 
\. Size of class. Small classes are preferred by most teachers, yet any reduction 
in the ratio of class teachers to pupils is an expensive policy . and researchers 
have not always provided clear-cut findings on its effectiveness. In this 
study, the class sizes varied from 16 or 17 in Italy. Norway, and Dew'ark. 
to 36 and 38 in Hong Kong and Singapore. A straightforward comparison 
shows virtually no difference between high and low scoring countries. 
However, when adjustments were made for CDI. countries with larger 
classes fared better. The two Asian countries. Singapore and Hong Kong. 
were outliers here. Without them the difference would disappear. Similar 
trends were found for Japan and Korea in earlier lEA studies (e.g.. 
Postlelhwaite and Wiley 1992). 

4. Proportion ot female teachers in the .system. Countries varied in the 
proportion of female teachers in their primary schools, from 98 percent in 
Slovenia to only 46 percent in Indonesia. However, the two analyses were 
consistent in showing that high average reading scores were obtained in 
education systems with higher proportions of women teachers. While the 
difference was only 0.20 standard deviation in a straightforward contrast 
between high-scoring and low-scoring countries, it increased to 0.40 
standard deviation when adjusted for CDI. 

5 . >Jimher nfojficial .school days per annum. The number of days a school is 
open to students is often debated as an important ingredient in raising 
achievement levels. While this may be true in some subjects, it appears to 
have no bearing on reading achievement. In fact the opposite is the case. In 
countries where .schools arc open for more than 190 days the achievement 
levels are generally lower than when ihey are open for less than 180 days. 
Indeed, some of the systems which produced the highest achievers, relative 
to expectation, required schools to be open for fewer than 1 70 days. This 
finding is counter-intuitive, and open to a variety of interpretations. 
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6 Number of hours of instruction per ^veek. As the number of instructional 
hours per dav varies across countries, a further check on the t.me students 
attend school was undertaken by counting the number of hours ot instruc- 
tion per week. This time there was a slight advantage for more hours m 
school, especially after adjusting for economic differences 

7 Phonetic re^ularin■ of the language. It is often claimed that languages 
■ which show a regular correspondence between sound and symbol make 

leamine to read easier than those which have an irregular sound-letter 
correspondence. There is quite enough for the young child to remember 
without beine confused by exceptions in the orthography. To check out this 
hypothesis, the 15 main European languages used in Population A were 
rated on a five point scale according to the extent to which their graphemes 
mapped faithfully on to their phonemes. The results of this exercise are 
shown in Table 5.5. 
Table 5.5. Rating of languages according to phonetic regularity. 



Highly 
Regular 



5 


Finnish 


4 


Spanish, Italian, Portuguese, 
Hunearian. Slovenian 


3 


German, Dutch, Swedish, Morwegian, 
Icelandic. Greek 


2 


Danish. French 


1 


1 English 



9. 



Irregular 

Each country had these ratings applied according to its language of 
instmction. and' comparisons were made between the high-scoring and 
ov^^ ormg nations. While the Finnish and Itm,.an students' results bore 
out the hypothesis of the benefits of regularity, the results ot the remaining 
countrie; did not. The degree of regularity may be one tactor which assists 
tudents when the sound-symbol link is near perfect, and the teaching 
methods exploit that fact, but it is apparently not a major consideration in 
other languages by age nine. 

Policy of educating children in multi-grade classrooms In Nkw Zuauvm • 
PORU C.: . . and TK.N.DAD AND Tc.BAOO. over 70 percent ot teachers reported 
havin- multi-arade classes: in Gr.RMASV. S.noaporh. and Si.ovkn.a. n. ne 
did. While thi; policy may generate beneficial effects for students in «.me 
subiects. there was no difference found in this study between high-sconng 
and bw-scoring countries in the proportion of teachers with multi-grade 
classes before or after adjustment. 

Lrage number of rears teachers have staved ^a,h tlw.r present class. 
Several European-countries in this study have a policy ot encouraging 
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teachers to stay with one class for several years. In Italy, Denmark, France 
and Sweden, most teachers reported that they had been with their present 
class for more than two years: in most remaining countries the average time 
was less than one year. Initial inspection showed no difference in this 
respect (Table 5.3), but in those countries where literacy performance was 
above expectation, the teachers had spent somewhat less time on average, 
with their present class (Table 5.4). 

1 0. Number of years teachers have spent acquiring their education. American 
teachers reported an average of 17.2 years of education, Canadian (BC) 
teachers 16.8 years, and Norwegian teachers 16.6 years. By contrast. East 
German and Ditch teachers had less than eleven years education. These 
figures include school, university and teacher training. The ten high- 
scoring countries reported 13.8 years on average, and the low-scoring 
countries only 12.6 years, which represents a substantial difference. Even 
after adjustment for economic and social circumstances the difference still 
favored a longer education (see Table 5.4). 

1 1 . Percentage of teachers whose first language is different from that of the 
school. Most countries employ some teachers whose first language is 
different from that of the school. In Singapore (84 percent) and Indonesia 
( 78 percent ) such teachers are in the majority. Only Hungary and Portl'gal 
reported no such teachers. At this age, the difference is not large, cither 
before or after the adjustment for economic conditions. 

12. Easy access to hooks in the community at large. Many literacy surveys 
show access to books is related to reading ability. In this survey, principals 
were asked to report on whether the students had easy access to public 
libraries and to book-stores in the community, and students were asked to 
report on the number of books in the home. The percentage of students 
reporting over 100 books, was found to correlate highly with the other two 
access indicators, and as all had a :;imilar variance they were combined into 
a single index. Best access was found in the Netherlands (86 percent). 
Switzerland (84 percent) and Sweden (83 percent): the worst in Indonesia 
( 22 percent), Portugal (40 percent) and Venezuela (46 percent ). Table 5.3 
shows that high-scoring countries averaged 74,2 percent on this measure, 
substantially higher than low-scoring countries ( 62.0 percent). This factor 
is to some extent influenced by wealth, however, and after adjustment for 
economic conditions, it drops considerably in importance. 

13. Policy of investing in a large .school library. Countries vary considerably 
in the extent to which they make provision for school libraries. In Denmark, 
Singapore, the United Stxtes, Canada (BC), and Slovenia, principals 
report that their nine-year-olds have access to school libraries with over 
7000 books, on average. By contrast, typical school libraries in Portugal, 
Indonesia, Germany (E), Greece, Trinidad and Tobago and the Nether- 
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LANDS have fewer than 700 books . This study suggests that it is an important 
variaole in accounting for differences in reading literacy levels. When book 
numbers were categorized by thousands, the high-scoring countries were 
found to have much larger school libraries, and the difference was even 
greater after adjustment for economic and social conditions. 

14. Policy of having large classroom libraries. Some countries encourage 
schools to invest heavily in classroom "book-comers", where pupils can get 
more frequent access to books. The percentage of teachers reporting that 
they had a classroom library, and that it contained more than 60 books was 
determined. This figure revealed substantial differences in policy. In Hong 
Kong, Canada (BC), the Unffed States and Singapore, over 70 percent of 
students were in classrooms with large classroom libraries; in Germany 
(E), Hungary, and Slovenia, less than a third of teachers did. Table 5.3 
indicates that this is one of the most important differential policies between 
high-scoring and low- scoring countries of all those examined and Table 5.4 
confirms that it is not merely a sign of affluence. Effective reading 
programs are usually supported by large classroom libraries. 

15. Number of textbooks per student. Research in developing countries has 
frequently given support for the provision of more textbooks as a key 
variable in raising achievement levels (e.g.. Fuller 1987)). In this study, 
teachers were asked to estimate the number of textbooks available per 
student, but the question presented some difficulties at the nine-year-old 
level, as many countries make greater use of a range of children' s books and 
other resources, rather than 'official' textbooks. The straight comparison of 
high and low-scoring countries did show a difference favoring more texts. 
Low provision was found in Venezuela, Indonesia and Trinidad and 
Tobago. However, this factor could be a function only of wealth in this 
study as it di sappeared after adj ustment for economic and social conditions. 
It could also be seen as a threshold variable, important only up to a particular 
level of provision. Further study is needed of this indicator, within coun- 
tries. 

1 6. Frequency ofbook-horrowing by students. It i s one thing to provide books, 
but a more crucial question is whether students take advantage of this 
provision. Students were asked to report how often they borrowed books 
from school or public libraries, on a scale from Never (0) to More than once 
a week (5). While this variable may be suspect on reliability because of the 
doubtful ability of nine-year-olds to answer truthfully, it certainly showed 
a trend in the predictable direction. In high-scoring countries, students' 
borrowing mean was 3.27 (between Once a week and Once a month), while 
low-scorers averaged only 2.84. This observed difference was diminished 
after adjustment (see Table 5.4) but cannot be ignored. It merits furtlier 
study. 
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17. Time spent on teaching the language. Countries vary in the amount of time 
assigned to teaching reading and related language activities in the weekly 
timetable. In New Zealand, the United States, Canada (BC), Trinidad 
AND Tobago and Italy, teachers report spending 10 or more hours per week 
on language study; Slovenia and Finland report an average of only 3.9 
hours, while Germany (W) (5.0), Denmark (5.3), and Indonesia (5.1) also 
give it low priority. A straight contrast shows that high-scoring countries 
do spend more time on language study and the difference is still clear-cut 
after adjusting for economic conditions. How that time is spent is no doubt 
critical, but cannot be explored at this stage. 

1 8. Frequency of silent reading by students in class. In some countries, policies 
of independent silent reading in school are widely encouraged. In others, 
such a practice is not regarded as a valuable use of school time. Teachers 
were found to differ substantially between countries on this factor so it was 
analyzed further. In New Zealand, Canada (BC) and Hungary, teachers 
reported this practice almost every day; in Belgium, Denmark and Indone- 
sia, it was done less than once per week. In a straight contrast between high- 
and low-scoring countries there was no difference, but it was clearly an 
important factor in explaining differences between countries which fall 
above and below expectation on the basis of the CDI. Time spent reading 
in class is apparently not wasted time. 

1 9. Time spent by teachers reading aloud to pupils. In some countries, teachers 
report that they spend much time reading to students in class. In Canada 
(BC), New Zealand, Portugal and Greece, it occurs more than four times 
per week. By contrast, pupils in France rarely have this experience, while 
in Hong Kong, Germany (W), Hungary, Indonesia and Trinidad and 
Tobago, it happens less than one and a half times a week. In a straight 
comparison between high- and low- scoring countries, the difference favor- 
ing regular story reading is substantial. When adjusted for economic and 
social conditions, however, it is reduced to 0.25. 

20. Frequency of formal tests. The teachers in the survey were asked to state 
how often they tested their students' reading formally. For each country the 
percentages of those who responded weekly or monthly were combined, and 
comparisons made between high and low scoring nations. While the first 
comparison showed a benefit for those who tested least often, this pattern 
was reversed when the results were corrected by the CDI measure. In the 
highest ten countries, after adjustment, 54 percent of teachers tested their 
children at least monthly; in the lowest achieving countries, only 32 percent 
did. This difference is a strong one, though not consistent in every case. 
Teachers in New Zealand, the United States, and Hungary achieved high 
average scores without frequent testing. However, the relatively low 
figures of 3 percent, 5 percent, 8 percent, and 14 percent reported by 
teachers in Denmark, Norway, Germany (W) and the Netherlands respec- 
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lively, provide one probable reason for their scores, which were lower than 

expected. . 
-> 1 Students' speed of word recognition. Although this is not a policy indicator. 
' it is a likely influence on reading achievement. Most reading specialists see 
an important role for rapid word recognition in the reading process (Calfee 
and Drum 1986). The 40 item word-picture matching exercise given to 
Population A students was designed primarily to assess rapid word recog- 
nition and thus to help explain low scores in the other domains. While the 
task is admittedly onlv an indirect measure of the recognition process, it is 
unlikely that poor decoders would perform well on it. As predicted, the ten 
hieh-sJoring countries showed much higher average scores than the low- 
scoring nations, and the difference was still considerable after adjustment 
for CDI In fact, the correlation between the national total achievement 
means and the percentaee of students scoring below 50 percent on the word 
recounition test was 0.86. Furthermore, the gender differences on this test 
mirrored those of the other dovnains. Highest scoring countnes in the Word 
Recoanition Test were Singapore. Finland. Italy, the United States and 
Greece Children in Venezuela. Indonesia. Denmark and Germany (E) 
produced unusually low average scores, which may help account tor their 
lower achievement levels in the three other domains. It was noticeable that 
a few countries showed high performance levels in the Word Recognition 
Test without corresponding achievement in theirTotal Achievement scores, 
but that no country had the reverse pattern. Such patterns are consistent with 
the belief that rapid decoding is a prerequisite for good reading comprehen- 



sion. 



Educational Policy Indicators: Population B 

Which educational policy variables are related to national achievement among 
14-year-olds'' Are the trends similar to those for Population A? A compar on 
of high- and low-scoring countries, before and after adjustment for economic 
and social differences, is again revealing. 

Table 5 6 li-^'s those factors which are associated with the largest differences 
between the ten hiahest and ten lowest scoring countries. Again, the figures 
were drawn from the National Case Study Questionnaire, and the other ques- 
tionnaires completed by students, teachers and school principals. As some of the 
variables examined may well be regarded merely as correlates|^ot wealth rather 
than of sound educational policy, a second table is given (Table 5.7) showing 
the contrast between the ten countries which showed higher average scores than 
were predicted bv their economic and social status, and the ten countries which 
fell furthest below expectation. Any factor which clcariy differentiates coun- 
tries in both these contrasts must be considered an important variable, worthy 
of attention by policymakers and researchers. 
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Table 5.6. Relative importance of selected national policy indicators in rela- 
tion to national achievement means for Population B. 



Policy 
indicator 


Highest 
10 


Lowest 
10 


Diff/SD 


Difference 
as 


Advantage 
for . . . 




countries 


countries 




proportion 
ofSD 




1 Average Class 
size 


24.21 


34.89 


10.68/7.87 


1.36 


Smaller 
classes 


2 Pupil-teacher ratio 
in school 


0.065 


0.048 


0.017/0.023 


0.74 


More 
teachers per 
pupil 


3 Average School 
size 


631.8 


936.0 


304.2/402.6 


0.76 


Smaller 
schools 


4 % Female 
teachers 


65.7 


68.5 


2.80/18.69 


0.15 


No 
difference 


5 School days per 
year 


179.0 


184.8 


5.8/12.5 


0.46 


Shorter 
school year 


6 Hours instruction 
per week 


24.44 


26.11 


1.67/3.26 


0.51 


Shorter 
school 
hours 


7 Years teacher 
education 


15.27 


14.26 


1.01/1.90 


0.53 


More 
education 
for teachers 


8 % Other language 
speaking teachers 


10.6 


38.1 


28.5/28.9 


0.99 


More same 
language 
teachers 


9 Frequency 
principal 

evaluates teachers 


2.89 


3.53 


0.64/0.55 


1.16 


Less 
evaluation 


10 Frequency 
students given 
homework 


4.06 


3.75 


r\ 1 1 /r\ AO 
U.i l/U.4o 


U.Oj 


More 
gciicr<ti 
homework 


11 Frequency 
students given 
rdg. homework 


1.20 


2.03 


0.83/0.60 


1.38 


Less 
reading 
homework 


12 Textbooks per 
student 


1.69 


I.IO 


0.59/0.51 


1.16 


More 
textbooks 


13 Size of school 


5.20 


2.50 


2.70/2.84 


0.95 


More books 


librarv 












14 Level of resources 
for reading 


4.05 


3.14 


0.91/1.11 


0.82 


More 
resources 


15 Frequency of 
comprehension 


.093 


2.06 


1.13/0.82 


1.38 


Fewer tests 


tests 












16 Policy of 

individual tuition 


62.1 


41.9 


20.2/26.5 


0.76 


More 
mdividual 
tuition 
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Table 5.7. Relative importance of selected national policy indicators for Popu- 
lation B after adjustment for economic and social conditions. 



Policy 
inO ator 


Highest 
10 

countries 


Lowest 
10 

countries 


Difference 
Diff/SD as 

proportion 
ofSD 


Advantage 
for . . . 


I Average Class 
size 


26.48 


27.32 


0.84/7.87 


0.11 


difference 


2 Pupil-teacher ratio 
in school 




xj.yjvht 


0.001/0.023 


0.04 


No 
Qiiierciiv-c 


3 Average School 
size 


769.0 


582.2 


186.8/402.6 


0.46 


Larger 
schools 


4 % Female 
teachers 


76.40 


51.10 


25.30/18.69 


L35 


More 
female 
teachers 


5 School days per 


170.8 


185.2 


14.4/ IZ.O 


1 IS 


Shorter 
school vear 


year 

6 H» jrs instruction 
per week 


25.30 


25.57 


0.27/3.26 


0.08 


No 
difference 


7 Years teacher 
education 


15.60 


14.72 


0.88/1.40 


0.63 


More 
teacher 
education 


8 % Other language 
speaking teachers 


8.9 


26.5 


17.6/28.9 


0.61 


More 
oiticial 
language 
speaking 
teachers 


9 Frequency 
principal 

evaluates teachers 


2.99 


3.05 


0.06/0.55 


O.ll 


No 
aiiierenLc 


10 Frequency 
students given 
homework 


4.16 


3.73 


0.43/0.48 


0.90 


More 
homework 
in general 


1 1 Frequency 
students given 
rdp. homework 


1.58 


1.41 


0.17/0.60 


0.28 


difference 


12 Textbooks per 
student 


1.32 


1.51 


0.19/0.51 


0.37 


Fewer 
textbooks 


13 Size of school 
library 


4.20 


2.70 


1.50/2.84 


0.53 


Larger 
school 
libraries 


14 Level of resource 
fnr reading 


^ 3.84 


2.98 


0.86' M 


0.77 


More 
resources 


1 5 Frequency of 
comprehension 
tests 


1.46 


1.31 


0.15/0.82 


0.18 


No 
difference 


16 Policy of 

individual tuition 


52.5 


44.5 


lLO/26.5 


0.42 


More 
individual 
tuition 
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It should be noted that the 3 1 countries which participated in the 14-year-old 
survey were not identical to the 27 which were involved in the Q-year-old survey . 
A few differences in the findings may then be attributable to the fact that the 
Population B study contained a larger number of developing countries. 

1. Average class size. Countries whose teachers reported smaller classes 
certainly achieved better results at age 14 years. While the high-scoring 
countries have typical classes of 25, the low scorers have average class sizes 
nearer 35. This is one of the largest correlates of differences in literacy 
achievement. However, it is clearly a factor which is influenced by the 
ability to afford more teachers, and when adjusted for discrepancies in 
wealth the difference disappears, 

2. Pupi teacher ratio in a school. School principals also reported the number 
of pupils in their schools and the total number of teaching staff, excluding 
administrators and counselors. The pupil-teacher ratio, calculated from 
these figures, showed similar trends to those of the class-size variable. 
Countries with more favorable ratios obtained better results, but the 
differences virtually disappeared after CDI adjustment. 

3. Size of school. Five countries reported average school enrollment figures 
over KXX) students, with particulariy high numbers in the Philippines 
(1833). PoRTLT.AL (1565) and Thailand (1691). By contrast, Finland, 
Greece. Italy. Norway, and Switzerland reported schools of less than40() 
students. A straightforward comparison of high- and low-scoring countries 
gives the advantage to countries with smaller schools (632 vs. 936 stu- 
dents ). but this is again a policy associated with wealthier countries. When 
other things arc made - ^aal, countries with larger schools produce better 
results in relation to the resources they have available. Once again, these 
results are unduly infiuenced by two Asian countries. Hong Kong and 
Singapore , with very large schools. 

4. Percentage of female teachers. As in Population A, countries with larger 
proportions of female teachers show higher literacy achievement levels 
relative to their economic conditions. Before the adjustment there was little 
difference. 

5. Number of days per year the schools are open. Once again, the advantage 
lies with countries which require students to attend school for less than 1 80 
days perannum, before and after adjustment for resources. A shorter school 
year (within limits) does not appear to handicap students when judged on 
a criterion of reading literacy. 

6. Number of hours of instruction per week. At age 1 4. countries which spend 
less lime in school produce somewhat higher average achievement, but the 
difference may well be a function of wealth, and appears to be of little 
consequence after adjusting for levr! development. 



ERIC 



69 



How Do High-Achieving Countries Differ? 



7. Number of years of education for teachers. As in Population A, a few 
countries expect their teachers to undergo long periods of education and 
training. Canada (BC), Germany (W), Italy, Norway, the United States, 
and Venezuela all require more than 17 years; Botswana, Denmark, the 
Netherlands, the Philippines, Singapore, Thailand and Zimbabwe expect 
only 13 years or less. The extra years of education do suggest a positive 
influence, before and after adjustment for economic differences. 

8. Percentage of teachers whose first language is different from that of the 
school. Countries which employ large numbers of teachers whose native 
language is different from that of the school do not produce as high literacy 
achievement levels in their students as native language speaking teachers, 
regardless of economic conditions in the country. This variable is more 
important at secondary school level than it proved to be with nine-year- 
olds. 

9. Frequency with which the school principal evaluates the work of teachers. 
Policies concerning the role of the principal in evaluating teachers' work 
appear to vary considerably cross-culturally. This practice does not seem 
to have an influence on student reading achievement, however. In Botswana, 
Cyprus, Italy, Nigeria, the Philippines, and Zimbabwe principals typically 
evaluate more than once per year, while in nine of the ten high-scoring 
countries teacher evaluations by the principal occur about once a year. The 
question is not relevant in Switzerland's schools, which operate without 
full-time principals. In Greece, Portugal, Denmark, and the Netherlands, 
all middle-scoring countries, the practice is rarely undertaken. This vari- 
able warrants further investigation. 

10. Frequency with which teachers assign general homework. In their com- 
parative studies of Asian and American classrooms, Lee, Stigler and 
Stevenson (1988) identified amount of homework as one factor which 
enhances the peif ormance levels of Asian students. They are expected to do 
more homework than American students, and it appeared to produce higher 
achievement. In this study there were also clear differences between high- 
and low-scoring countries favoring the value of general homework at the 
1 4 -year-old level. This pattern was repeated after adjusting for economic 
conditions. The amount of homework assigned appears to be a stable 
influence for reading literacy achievement across countries. 

1 1 . Frequency with which teachers assign reading homework. Apparently not 
2ll forms of homework are equally effective. Countries where teachers 
assigned large amounts of reading homework did not produce the same 
levels of achievement as those who assigned less. However, this difference 
disappeared after CDI adjustment, and is probably not conclusive. Cross- 
cultural differences in what teachers perceive as reading homework may 
have affected the outcome. 

i J 
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12. Number oftextbooks per student. Atthe9-year-oldleveI,thisfactorshowed 
a correlation with performance, but appeared to be more a sign of affluence 
than a cause of achievement. The same trend appeared at age fourteen. 
High-scoring countries did report more textbooks per student, but countries 
which achieved well above prediction had no more textbooks than those 
scoring below. 

1 3- Size of the school library. As in the Population A survey, school library size 
is a powerful factor, differentiating clearly between high- and low-scoring 
countries, regardless of economic conditions. The top ten countries have 
libraries over twice as large as in the low-scoring countries, and the 
difference is almost as impressive after adjusting for CDI. 

14. Level of resources for reading. School principals were asked to indicate 
whether their schools contained a set of eight facilities which were 
hypothesized to be indirect indicators of policies designed to encourage 
reading growth. The facilities were: a library, student reading room, student 
newspaper, teacher library, drama club, debating club, literature club and 
writingclub. Highest on this combined indicator were Slovenia, Singapore, 
New Zealand, the United States, and Hong Kong, all close to an average 
of five resources; lowest were Botswana, Germany (E), Greece and 
Venezuela with less than two. Predictably, the high-scoring countries 
provided considerably more of these resources for encouraging reading, 
and the difference was even greater after adjusting for economic differ- 
ences. These resources are either causes of or signs of commitment to 
higher literacy levels. 

15. Frequency with which teachers set comprehension tests of reading. At the 
nine-year-old level more testing was related to higher achievement in the 
countries which scored above expectation, but this trend was not observed 
at the fourteen-year-old level. Teachers in the high-scoring countries 
reported less than half the frequency of testing than those in the lower 
achieving countries. Thus, Finland, New Zealand, Sweden and Switzer- 
land produced high literacy levels with testing policies of less than once per 
week; by contrast, several other countries reported giving children reading 
comprehension tests three to four times a week, without apparent benefit. 
After adjustment for economic and social conditions, there was no differ- 
ence on this variable. 

16. Provision of special individual tuition for students. This policy varies 
widely across countries, and is therefore worthy of attention at this point. 
In Denmark, Hungary, and Iceland, over 90 percent of principals report 
such a policy; in France, Greece, Hong Kong, and the Netherlands, less 
than 20 percent reported it. The contrast between high- and low-scoring 
countries showed that it was a correlate of successful instruction, and after 
adjustment for CDI, it still appeared to be a favorable indicator. 
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Many other variables hypothesized to be correlated with achievement we 
captured in the questionnaires, and they will be investigated in further analys. 
within and between countries. 



Table 5.8. Summarv of findings on policy indicators showing the compari 
sons unadjusted and adjusted for CDI: Populations A and B. 





PoDulation A I 


Population B 


Advantage shown for: j 


nadjusted 


Adjusted jU 
for CDI 1 


nadjusted 


Adjusted 
for CDI 


I . Smaller classes 1 


no 1 


yes 


More female teachers 


yes 1 


no 




3. Shorter school year 1 


yes 


yes 


yes 


yes 


4. More hours Dcr week 1 


yes 


yes 1 


no 




5. More years teacher 1 
education 1 


yes 


yes 1 


yes 


yes 


6. More textbooks per 

student 1 


yes — j 


yes 


no 


7 Lareer school librarv 1 


yes 


yes 1 


yes 


yes 


8. More formal tests 1 


no 


yes j 


no 




9. Earlier starting age 1 


no 


yes 1 




10. High preschool j 
enrollment 1 


yes 






1 1 . More multigrade classes | 






1 2. More years with same ] 
class 


no 1 




13. More books in 
community 


yes 




14 Larger classroom library 


yes 


yes 




15. More library books 
borrowed . 




yes 




16. More lime teaching 
language 


1 yes 


yes 




17. More silent reading in 
class 




yes 




18. More teacher reading to 
class 


1 — yes 




19. Students faster word 
recognition 


T yes 


yes 




?0 Better puoil-teacher ratio 






21. Principal evaluates 
teachers more often 




1 no 


22. More general homework 
given 




1 yes 


yes 


23. More reading homework 
given 




j no 


24. More resources for 
reading 




yes 


yes 


25, More individual tuition 




1 yes 


yes 
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To assist the reader, a summary of the major findings from Tables 6.3. 6.4, 
6.6 and 6.7 is presented in Table 5.8. This table lists, first, the policy variables 
which were analyzed in both populations, then those which were confined to 
only one population. The table shows in which cases each variable differentiated 
clearly between those countries in the high achievement levels and those with 
low achievement. A Yes in the adjoining column( s ) denotes an advantage above 
0.3 SD was found for the variable; a No denotes a disadvantage greater than 0.3 
SD. A dash indicates that the correlation for that variable was less than 0.3. The 
table also shows whether the variable was still an im,portant differentiating 
factor when the economic and social conditions of the country were adjusted for 
by the CDI. 

Thus, in the case of Variable I , an advantage was shown for smaller classes 
in a straight comparison of high and low achieving countries at both ages 
(columns 1 and 3). In Population A. however, the ten countries which achieved 
most above expectation had largerclassc- column 2); in Population B there was 
no difference oetween countries which exceeded expectation and those which 
fall below expectation (column 4). A study of this table shows that some policy 
variables differentiate clearly at both levels in both kinds of analyses. The most 
prominent are a shorter school yean more teacher education and larger school 
libraries. For policy N'ariables examined at Population A level only, the most 
consistent factors were lar^^e classroom library, more books borrowed, more 
hours teaching the language, more silent reading and faster word recognition. 
For variables unique to Population B. the consistent factor were more general 
homework, more resources for reading and more individual tuition. 

The Case of Finland 

It is clear that the students of Finland show consistently high average scores at 
both age levels across all kinds of reading. The question arises as to why their 
students are so successful. A full explanation of this question is beyond the scope 
of this booklet. There are no doubt many reasons, and some will be difficult to 
determine. They may 1 ie, for instance, in the quality of the teaching and the value 
attached to literacy in the community. Nevertheless, a few tentative explana- 
tions can be offered, on the basis of information available at this stage. 

I . The Finnish language has an unusually regular orthography. By and large 
each sound is represented by a single symbol, and each symbol stands for 
only one sound (Kyostio 1980). Many educators believe that this feature 
makes it easier for young children to crack the literacy code. While the 
benefits of such regularity are not apparent in this study across the whole 
range of languages, this factor cannot be ruled out for a language which is 
so neariy perfect in its phonetic correspondence. Certainly it is easier lo 
justify a strong synthetic-phonic approach to literacy acquisition than in 
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other languages. Such methods are in common use, but teachers also report 
a variety of methods and emphasize comprehension, interest and critical 
thinking. 

2. Finland is a relatively wealthy country. A has one of the highest GNPs per 
capita, and it spends more than most countries on its schools. Thus, it can 
attract able young people into teaching and afford smaller classes. The 
World Education Report (Unesco 1991) lists Finland as having the second 
best pupil-teacher ratio among the countries in this study. Health indicators 
are also impressive. 

3. The Finnish speaking schools are homogeneous linguistically. Finland is 
a bilingual state where the 94% of the people speak Finnish and 5.8% speak 
Swedish as their native tongue. However, the Finnish and Swedish speak- 
ing children go to separate school systems from kindergarten to university. 
Only the Finnish speaking school system (95% of the students) participated 
in the international study, although the Swedish speaking system was 
assessed as a national option Minority language students were not ex- 
cluded from the testing if they attended Finnish speaking schools. How- 
ever, the Finnish speaking classrooms are very homogeneous linguisti- 
cally. Monolingual countries tend to have higher reading scores. 

4. Literacy is important in Finland. It reports 99 percent adult literacy rate, the 
largest number of public library books per head in the sample, and one of 
the highest figures for newspaper circulation and book publication. Thus, 
there are probably many good adult models and high expectations exerted 
on children to learn to read. 

Several other hypothetical reasons for the Finnish performance levels can be 
rejected at this stage. 

1 . Early start: Fewer than half the children can read at age seven when they 
enter school. 

2. More hours instruction in reading: The Finnish timetable allows less than 
average time on reading, on language study and in school as a whole. 
However, the guiding phrase "Every teacher is a mother tongue teacher" is 
common in teacher training as well as in the written curriculum, especially 
in the primary level where an integrated curriculum has become the usual 
practice. 

3. More testing: The number of teachers reporting frequent testing is only 
average, since testing in reading is not generally favored. Instead, Finnish 
teachers prefer student centered assessment methods that are closely 
designed for instniction, such as writing assignments, discussions, or 
project work. Some studies (e.g., Hiebert andCalfee 1992) support this type 
of assessment as correlated with high level performance. 
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4. More teacher training: The figures are again only average, and below 
average for in-service training. These numbers, however, reflect an over- 
lapping of two generations of teachers. Before 1977, primary teachers 
needed only three years of training and many of these teachers are still in 
the school system. Since 1977, teachers at all levels pursue academic 
studies for four to six years to complete the master's degree. The first 
teachers trained under the new system appeared in the schools in 1981 , It 
should be noted that the teaching profession attracts candidates from 
among the most talented students in the high schools, especially girls, 

5. Less TV: Finnish students watch TV just as much as their counterparts in 
other countries. It may be significant, however, that the children of Finland 
are exposed to many foreign TV films with Finnish subtitles which they 
have to read rapidly and often during the program (see Chapter 7). 

This discussion has presented only a few of the possible factors at work in 
the Finnish culture and its educational policies which promote good reading 
among their young students. Several strong points, however, are clearly the 
result of thoughtful self-examination and planning within the profession and 
warrant further investigation. 



CHAPTER SIX 



DIFFERENCES IN ACHIEVEMENT BY 
GENDER, HOME LANGUAGE AND URBAN-RURAL 

LOCATION 



Gender Differences 

Previous international studies of reading have siiown that girls tend to surpass 
h(ws in most countries and cultures, both in their reading interest (Guthne and 
Greaney 1991) and their achieven:ient levels in reading (Thomdike 1)73. 
Downin" 197^) Opinion differs however, as to whether these differences are 
nrimarilv maturational or culturally conditioned. Preston (1962) found empiri- 
cal support for the latter view when he showed that boys surpassed girls in 
readino achievement in Gi-rmany. but were consistently behind girls in the 
UNireo .ST VTrs. He notec that, at that time, male teachers predominated in 
primarv schools in Germany, while the reverse was true in Amencan schools. 
Buildin" on this research. Johnson (1974) investigated gender difference m 
rcadin""'ai Grades 2. 4 and 6 in four countries, and found support tor Preston s 
position Bovs in Nigeria and Germany achieved well and more often had been 
;au"ht bv male teachers than boys in Canada and the Unithd States where the 
boys fared less well than the girls. A plausible explanation is that boys identity 
better with the values of male teachers than with female teachers. 



Girls 
Bovs 



4(K) 



(■,\p()siuiry 



l)>H.'uiiicnt> 



<)M,-r;ill .ivi.Taco 



Population .-^ 
AchiONCinoiU ascrago 

450 ?00 
I 1- 



SIO 



491 



507 



W5 




507 



495 



4(X) 



Population B 
\chiovoment asoragi; 

450 ?(X) 



510 




Fiiiure 6.1 . Differences in reading achievement of boys and girls 
^ across all countries by domain and overall, favoring girls 
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In the present study, gender comparisons were made across all countries at 
both age levels and further light was thrown on this issue. Tables 6.1 and 6.2 
present the score differences in raw form and in standard score form. In the 
column marked ^difference' an asterisk is placed next to those values where, 
after taking into account the standard errors of sampling, the differences are 
significant. For Population A the following results were found: 

1 . Giris achieved at higher levels in all countries. There was no country where 
boys were ahead in the overall score (Figure 6. 1 ). Giris were also consis- 
tently ahead in Narrative and Expository reading. 

2. The smallest differences were found in the Documents domain in every 
case. In fact, the boys' average scores actually exceeded the giris' slightly 
in six countries: Franch. Germany (W), the Netherlands, Switzerland, 
Spain, and the United States. 

Table 6. 1. Gender differences in overall scores (with standard error of sam- 



pling) by country: Population A 





Average score 






Country 


(s.e 


^ 








Bovs 


Giris 


C 


lifference 


Belgium/Fr 


503 (4.5) 


512 (4.5) 


9 


.12 


Canada/BC 


495 (5.4) 


506 (5.4) 


11* 


.14 


Cyprus 


479 (3.2) 


484 (3.2) 


5 


.07 


Denmark 


463 (5.5) 


489 (4.9) 


26* 


.34 


Finland 


564 (4.5) 


575 (4.5) 


11* 


.14 


France 


530 (5.7) 


533 (5.6) 


3 


.04 


Germany/E 


490 (6.3) 


509 (6.1) 


19* 


.24 


Germany/W 


501 (3.9) 


508 (3.8) 


7 


.09 


Greece 


499 (4.4) 


510 (4.2) 


11* 


.14 


Hong Kong 


512 (3.7) 


524 (3.6) 


12* 


.15 


Hungary 


495 (3.8) 


504 (3.6) 


9 


.11 


Iceland 


508 (0.0) 


528 (0.0) 


20* 


.24 


Indonesia 


394 (3.6) 


397 (3.7) 


3 


.04 


Ireland 


502 (5.2) 


517 (5.0) 


15* 


.19 


Italy 


525 (5.2) 


537 (5.1) 


12* 


.15 


Netherlands 


483 (5.4) 


488 (5.2) 


5 


.06 


New Zealand 


519 (4.1) 


539 (4.0) 


20* 


.25 


Norway 


517 (4.6) 


533 (4.0) 


16* 


.18 


Portugal 


474 (4.5) 


483 (4.5) 


9 


.11 


Singapore 


510 (1.3) 


521 (1.3) 


11* 


.14 


Slovenia 


491 (3.3) 


506 (3.4) 


15* 


.19 


Spain 


500 (3.4) 


508 (3.3) 


8* 


.10 


Sweden 


533 (4.4) 


546 (4.3) 


13* 


.16 


Switzerland 


507 (4.2) 


517 (4.2) 


10* 


.13 


Trinidad/Tobago 


443 (4.3) 


460 (4.1) 


17* 


.21 


United States 


543 (3.6) 


552 (3.4) 


9* 


.11 


Venezuela 


379 (4.2^ 


1 392 (3.9 


) 13* 


.16 



* = significant difference 1.05 level) 
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3. The largest differences between boys and girls were found in the Narrative 
domain, in almost every case. In six countries. Denmark. New Zealand. 
Iceland. Germany (E). Norway and Trinidad and Tobago, the differences 
were quite considerable. 

These sender differences are not ver>' large. There are very good male 
readers in every country, and many boys achieve well above the average girl m 
every country. However, in 17 of the 27 countries at the Population A level the 
"iris- mean was areater bv at least ten points on the average score. The very 
consistency of this gender gap across cultures at age nine provides some support 
for a maturational viewpoint. 

Table 6.2. Gender differences in overall scores (with standard error of sam- 



Country 



1 Average score 




Itandard 


1 (s-e-l C 


)ifference 


score 


1 Boys 


Girls 


d 


ifference 


1 

480 (5.2) 


486 (5.4) 




.\j<y 


327 (3.2) 


333 (2.8) 


Q 


.wo 


513 (3.4) 


534 (3.3) 






493 (3.0) 


501 (3.2) 


o 


1 1 
. 1 1 


523 (2.9) 


527 (2.8) 


A 


06 


1 554 (3.7) 


DOS (J.o; 




. i 7 


553 (5.0) 


549 (4.2) 


A 
-4- 




523 (4.0) 


530 (4.0) 


7 


.10 


522 (4.4) 


526 (4.4) 


4 


.06 
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Belgium/Fr 

Botswana 

Canada/BC 

Cyprus 

Denmark 

Finland 

France 

Germany/E 

Germany/W 

Greece 

Hong Kong 

Hungary 

Iceland 

Ireland 

Italy 

Netherlands 

New ZeaJand 

Nigeria 

Norway 

Philippines 

Portugal 

Singapore 

Slovenia 

Spain 

Sweden 

Switzerland 

Thailand 



United States 
Venezuela 
Zimbabwe 

' = significant dilTcrcncc (.05 level) 
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However, the proportion of female teachers in the schools represented in the 
study did vary considerably, from 86 percent in Slovenia to 50 percent in 
Indonesia. Thus it was possible to investigate further the hypothesis that boys' 
pertbrmancc relative to girls' is reduced by the preponderance of female 
teachers in the primary school (Table 6.3). 

Table 6.3. Percentage of female teachers in primary schools of countries with 
large and small discrepancies in gender means: Population A 





Country 


Score 


% Female 






discrepancv 


teachers 




Denmark- 


26 


57 


Large 


New Zealand 


20 


82 


Gender 


Germany/East 


19 


75 


Gaps 


Iceland 


20 


68 


Trinidad/Tobago 


17 


73 




Mean 


20.4 


70.9 




Indonesia 


3 


50 


Small 


France 


3 


67 


Gender 


Netherlands 


5 


53 


Gaps 


Cyprus 


5 


55 




German vAVest 


7 


71 




Mean 


4.6 


59.2 



In fact, there is some support for the teacher gender position in these figures. 
In the five countries where 9-year-old girls were found to be furthest ahead of 
boys. 71 percent of the primary school teachers were female; in the countries 
with the smallest gender gap, there were only 59 percent. It should be noted, 
however, that Denmark, with the biggest gap, had 57 percent female teachers 
while France, with the second smallest gap, had 67 percent female teachers. 
There are cleariy other factors at work here. 

Another hypothesis emerges from these findings, however. Three of the six 
countries with the largest gender gap start reading instruction at age five - Nhw 
Zealand, Trinidad and Tobago and Irel.and - and in two of these countries, the 
hoys are furthest behind at age fourteen. As a starting age of five is found in only 
four countries, it is cleariy a plausible hypothesis that boys are too immature to 
begin reading formally at age five, and that their difficulties are represented in 
low achievement, relative to giris. at both age levels. 

Table 6.2 presents the gender differences in overall achievement for Popu- 
lation B. At this level the gender gap has cleariy narrowed in all but nine 
countries. In fact, the mean difference dropped from 1 1.6 points to 7.1 points 
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overall and in two countries. Zimbabwe and Portugal, the boys showed 
Zif camly hieher means in average scores. Nevertheless, n .s st.U the case, 
world w"d th^t eirls are better readers at age fourteen, pamculady .n the 
Naaativl domain-Vhatever cultural tactors operated to produce better female 
reXatieninewereexertmgevenstrongereffectsatagel4inT.N.DA^^^^^ 

TOBAGO. iIano and Osa.a (BC). However, the boys ^ o-d ^ ^^^^^^ 
imorovement in Denmark. New Zealand. Germany (E), Slovenia Greece. 
NoRrA Po - Singapore and Venezuela. All gained ten po.nts or more 
on the girls- achievement levels in these countries: the Danish boys ga.ned 22 

The reasons for these changmg differences in gender gaps will be investi- 
gated further in other booklets in this senes. 

Home Langi.-ige Differences 

How many students receive schooling in a second language? 

A perenni'al issue in linguisticall nverse countrtes ,s the ^^-^^ ° /^e 

Wn^uaae of instruction for acquiring literacy. Convent.onal w.sdom has .t hat 

sSfswhosehomelanguagetsthatoftheschoolwUlha^^^^ 

in.n reading than those who have to learn a new language while they learn to 

Vndelu^^^^^^^^^^^ 
horianauaeewherepo..sible(Malmquist 1991). Although Wagner{99nhas 

ruei rfonmxry position, researchers in bilingual education generally agree. 
Thtrlre non-native speaking groups would be expected to score at lower 
levds on "eadm. iitcracv tests which are presented in the ot .cal anguage. 

t exp ore this matter, students were asked to state how often they used th 
lanllaJofthe test at home. At the 9-year-old level, more than half of the 
stXts in wTcountries - Singapore (73 percent, and Indonesia (73 percent 

renold^^^^^^^^ 

[he 4 yea.o d level, the countries with large numbers of such students were 
BoTSwlNUei percent,. PHii.iPP.NEr. (90 percent,. Singapore (74 percent, and 
1^ M^E 8 percent,. Among the remaining countries Nigeria. Italv and 
?HrND also had more than 20 percent different home language students^ 

Most Eu opean countries reported less than 1 5 percent of such children n 
their s m^^^^^^^ 

u . Zneen The most linguistically homogeneous populations were Hn _ 
NO GERNUNV (E). HUNGARY and Ireland with three percent or less second 
language students at the Population A level. 

How serious is a language discrepancy between home and school? 
T ?hT.T4 and 6 5 list for both populations, the countries in order of the size ot 
le a'h eve^m^^^^^^^^^^^ between the average scores (combined across 

s , fWthose learning in their home language and those who were not. 
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Table 6.4. Mean reading achievement score for students speaking a different 
language at home and for students speaking the school language: 
Population A 





Non-school language 


School language 


Home 




% 


Average 


% 


Average 


language 


Countr\' 


of students 


score 


of students 


score 


achieve- 


in sample 


(s.e.) 


in sample 


(s.e.) 


ment gap 


New Zealand 


8.4 


465 (9.6) 


91.6 


535 (3.0) 


70 


Sweden 


9.2 


486 (10.8) 


90.8 


544 (3.2) 




Norway 


4.1 


471 (16.7) 


95.9 


527 (3.1) 


56 


Germany/West 


10.5 


461 (8.1) 


89.5 


509 (2.9) 




France 


9.1 


491 (12.2) 


90.9 


536 (4.2) 


45 


Switzerland 


20.7 


476 (6.3) 


79.3 


521 (3.2) 


45 


Denmark 


4.7 


441 (15.9) 


95.3 


A Of\ / O O \ 

480 (3.8) 


39 


Singapore 


72.5 


505 (1.1) 


27.5 


543 (1.9) 


38 


Finland 


L5 


532 (27.6) 


98.5 


569 (3.2) 


37 


Greece 


6.4 


472 (12.6) 


93.6 


508 (3.1) 




Hong Kong 


12.6 


488 (7.3) 


87.4 


522 '2.8) 


34 


Slovenia 


11.5 


469 (6.8) 


88.5 


502 \1.5) 


33 


Hungary 


2.8 


468 (14.3) 


97.2 


50\ (2.7) 


33 


Iceland 


3.5 


487 (0.0) 


96.5 


jiy (U.U; 


32 


Belgium/France 


11.4 


481 (9.5) 


88.6 


512 (3.3) 


31 


Netherlands 


12.5 


459 (11.0) 


87.5 


489 (4.0) 


30 


UnitedStates 


3.5 


520 (12.3) 


96.5 


549 (2.5) 


29 


Germany/East 


1.7 


472 (28.4) 


98.3 


500 (4.4) 


28 


Italy 


26-9 


513 (6.9) 


73.1 


537 (4.1) 


24 


TrinidadA'obago 


14-7 


439 (7.9) 


85.3 


456 (3.2) 


17 


Ireland 


3.0 


495 (23.2) 


97.0 


510 (3.7) 


15 


Canada/BC 


11.0 


488 (10.4) 


89.0 


502 (4.1) 


14 


Portugal 


3.4 


469 (19.1 


) 96.6 


479 (3.2) 


10 


Indonesia 


72.5 


394 (3.0^ 


► 27.5 


403 (5.1) 


9 


Spain 


13.4 


499 (6.2^ 


1 86.6 


505 (2.5) 


6 


Cyprus 


3.7 


476 (13.6 


) 96.3 


482 (2.3) 




Venezuela 


17.8 


383 (6.3 


) 82.2 


388 (3.2) 


1 5 



At the top of this list of home language achievement i^aps. at both age levels, 
is Nfav Zealand whose non-English speaking children scored 70 points below 
the mainstream English-speaking students at the 9-year-old level . and 8 1 points 
at age fourteen. The minorities in this case were made up predominantly of 
Pacific Island students, whose literacy traditions are often not strong, although 
ihey may value education highly. These students are clearly experiencing 
difficulties with reading requirements in the official language. 

For Population A, second language students in Swhdhn and Norway also 
scored well below students who spoke the official language, by 58 and 56 points 
respectively. By contrast, the non-native language speakers of Cvpri-s, Vhnhzi;- 
kla, Spain and Indonfsia were reading almost as well as the native speakers in 
those countries. 
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Table 6.5. Mean reading achievement score for students speaking a different 
language at home and for students speaking the school language: 
Population B 



Country 





Non-school language 


School language 


Home 




% 


Average 




Average 


language 




of students 


score 


of Students 


score 


achieve- 




in sample 


(s.e.) 


in sample 


(S.e.) 


ment gap 




J.D 


Aid n s o^ 


94.4 


551 (4.1) 


81 




ft A 


ASS f in 7^ 


91.6 


530 (3.2) 


75 




J.O 




96.2 


539 (4.4) 


61 








99.6 


497 (2 2) 


60 




Z.J 




97.5 


527 (2.0) 


57 


[ 


O. / 




91 3 


491 (3 9) 


56 




J. 1 


sni r in 8^ 


94.9 


549 (2.3) 


48 




1 j,U 


AQ7 fA 7"^ 


85.0 


544 (2.5) 


47 




1 Q 
l.V 


47'^ /^lo s^ 


9R I 


519 (2.2) 


46 




u.o 


AQ'l f^S Q"^ 


99 4 


536 (2,7) 


43 




7/1 1 
/4. 1 






566 (2 3) 


43 




/I 1 
4.1 


AOS M 4 0\ 


QS Q 

yj.y 


537 (2.8) 


42 




ZD. 1 


488 fS n 

too yj.i) 


73.9 


525 (3 3) 


37 






siA fiA n 


96.1 


552 (3.3) 


36 




1 0 




98.8 


513 (3.6) 


31 


fO 


1 A 1 
10.1 


HJD yJ.y) 


83.9 


485 (1.9) 


29 


u.o 


J J J \Jo, I ) 


99.4 


562 (2 6) 


29 




9.1 


489 (12.6) 


90.9 


518 (3.7) 


29 




0.4 


508 (0.0) 


99.6 


536 (0.0) 


28 




6.3 


506 (8.5) 


93.7 


534 (2.3) 


28 




5.3 


394 (11.7) 


94.7 


421 (2.6) 


27 




2.8 


487 (13.4) 


97.2 


510 (2.3) 


23 




89.6 


428 (2.1) 


10.4 


449 (8.1) 


21 




1.6 


504 (18.6) 


98.4 


524 (2.4) 


20 




7.6 


506 (8.3) 


914 


524 (2.4) 


18 




83.2 


371 (3.1) 


16.8 


385 (9.31 


14 




11.4 


481 (6.8) 


88.6 


491 (2.4^ 


10 




61.4 


328 (2.7) 


38.6 


334 (3.4^ 


) 6 




0.8 


521 (32.1) 


99.2 


527 (2.8 


) 6 




38.7 


476 (6.8) 


61.3 


479 (6.0 






41.2 


403 (*) 


58.8 


400 (*) 


1 -3 



New Zealand 
Germany/West 
United States 
Cyprus 
Denmark 
Belgium/French 
Sweden 
Switzerland 
Norway 
Hungary 
Singapore 
Kong Kong 
Italy 
France 
Ireland 



Finland 
Netherlands 
Iceland 
Slovenia 
Venezuela 
Greece 
Philippines 
Portugal 
Canada/BC 
Zimbabwe 
Spain 
Botswana 
Germany/East 
Thailand 
Nigeria 

Insulficieni data lo calculate ihc Desiiin EtTeci 

For Population B, the largest discrepancies, after Nbv Zealand (81 ), wore 
shown hy Gkrmany (W) (75^ the United St\tes(61 ), Cm^rus (60), Denmark 
(57). Belgium (Fr) (56). On the other hand, second language students appear to 
have relatively less difficulty reading the school language in Nigeria. Tmailanix 
Germany (E), Botswana and Spain. 

How much are the national means affected by the presence of large numbers 
of different home language students? The average scores for students who speak 
the official language, as presented in Tables 6.4 and 6.5. are in most cases within 



6 2 



Gender. Home Lanauaae and Urban-Rural Differences 



three to five points of the national averages for the total sample. For Singapore 
9-ycar-olds however, the 28 percent of students who claimed to speak English 
at least often in their home scored an aver ige of 543 which is 28 points higher 
than the nationa' mean, and close to the highest national means in the study. The 
14-year-olds who spoke the test language (English) at home performed even 
better, with a mean of 566, which is the highest of all countries. As noted earlier, 
there are many students in Singapore whose reading levels are well above 
expectation. Even those whose home language is not the test language showed 
scores above the international mean. Only Finland, the United States and Italy 
showed similar patterns in Population A. 

At Population B level, those students not speaking the test language at home 
in Germany (E), France, and Finland all scored well above the international 
mean. It should be borne in mind thai school systems with large numbers of 
students not speaking the test language at home are more likely to have special 
instruction for these students than schools with small numbers of them espe- 
cially in Population A. 
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Figure 6.2. Mean scores for seven countries with largest advantage 
for urban students. Population A 
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Urban-Rural Differences 

Traditionally, urban students have had many educational advantages not en- 
joyed by their rural counterparts. Schools typically have better resources in the 
cities, better qualified teachers prefer to live in cities, and more cultural 
amenities are usually available for students. Such advantages have typically 
been reflected in higher achievement levels for urban children, especially at the 
secondary school level In the present study this was the case in most countries. 
At the 9-year-old level, a group of seven countries, predominantly with lower 
national economic indicators, followed this pattern of lower performance levels 
in rural schools, and progressively higher scores as the size of the community 
increases (Figure 6.2). Students in cities are typically more proficient than the 
children from small villages by half a standard deviation. (The values for these 
figures are found in Appendix G.) 
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Figure 6.3. Average scores for countries with negligible differences 
between urban and rural conditions: Population A 

However, a number of countries have been able to narrow the gap in 
educational and cultural opportunities by providing rural library facilities, 
establishing teacher recruitment schemes to attract good teachers to rural 
schools, setting up better transport systems and other such measures. Such 
policies of equal' nng amenities could well be reflected in the flat graph 
produced for Population A in five countries. Finland, Sweden, Denmark, 
Belgium (Fr) and the United States show no gap at all between urban and rural 
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students' achievement levels (Figure 6.3). An alternative interpretation, of 
course, is that the students in urban areas in these countries are disadvantaged 
due to poverty and depressed living conditions. 

600 -I , 
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Village Small Town Large Town City 

Figure 6.4. Average scores for three countries with 
advantage for rural students: Population A 



Finally, there is a group of three countries with an unusual pattern of scores 
favoring rural schools. In France, Switzerland and New Zealand it is the urban 
students who are disadvantaged at age 9 (Figure 6.4). Only in New Zealand, 
however, was this rural advantage carried through to secondary school. 

Despite these few unusual cases, this chapter has shown that there is a 
consistency in patterns of achievement across countries favoring girls, students 
who speak the language of the school, and students from urban areas. 



CHAPTER SEVEN 



OTHER INFLUENCES ON ACHIEVEMENT 

Availability of Books 

Surveys of achievement in a number of countries have shown that the numbers 
of books available to students is a key factor influencing their levels of reading 
ability (Fuller 1987). Furthermore, a recent review of "book flood" studies in six 
countries, in which large numbers of high interest books were provided for 
schools, showed consistently beneficial effects (Elley 1991), The findings 
reported in Chapter 5 about the mean size of school and class libraries are also 
consistent with these conclusions. It seems that good readers require a plentiful 
supply of books. As a variable which policymakers can influence, it is worthy 
of further study across all countries. 

The present survey investigated the availability of books by asking students, 
teachers and school principals to estimate the numbers of books there were in 
the students' homes and at school, and the availability of libraries and book- 
stores in the students' neighborhoods. 

Number of books at home 

In both age groups, the number of books students reported at home showed 
clear-cut relationships with their achievement levels. Students were asked to 
estimate the number of books there were in their homes - from 0 to over 200 - 
in six categories. 

At population B level, the median number of students reporting more than 
100 books in the home was near 50 percent, with particularly high numbers in 
Canada (BC), Denmark, Hungary, Iceland, New Zealand, Norway, Sweden. 
By contrast Botswana, Cyprus, Greece, Hong Kong, the Philippines and 
Zimbabwe, all reported less than 30 percent of homes with 100 or more books. 

Similar patterns were found at the 9-year-old level. Countries vary consid- 
erably in the availability of books in the home and these differences are clearly 
reflected in national literacy levels. 

More important for this survey is the pattern of achievement levels in relation 
to these figures. Figure 7. 1 presents the scaled scores averaged over domains, 
for selected Population A countries for students who reported 0, 1 - 1 0, 1 1 -50, 5 1 - 
1 00, 1 0 1 -200 and over 200 books respectively. The same information averaged 
over all countries is included for comparison. (The values for the figures in this 
chapter can be found in Appendix G.) 

Figure 7.1 reveals a steady upward rise in achievement at least to 51-100 
books, and up to 200 for four countries, with a leveling off for the majority of 
countries at that point. It is perhaps surprising that Hong Kong students 
managed to achieve at high levels without many books, along with the better 
resourced countries of Finland, France and the United States. In no country 
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did students achieve well from a background of bookless homes, and only in 
Hong Kong, Finland and the Unfted States did 9-year-olds score above the 
international mean of 500 when there were fewer than ten books at home. 
Clearly ready access to books at home seems to be an ingredient in making a 
good reader. 



600 




0 I - 1 0 11 -50 5 1 - 1 00 1 01 -200 more than 

200 

Number of Books in Home 



Figure 7. 1 . Average scores by number of books in home: Selected 
countries compared with all countries: Population A 

An even stronger pattern was observed in Population B. In 2 1 countries there 
was a steady increase in achievement in relation to the size of family book 
holdings, up to 200 plus. The threshold number of books for better reading 
performance at this age is somewhat higher than for 9-year-olds. 

Size of school library 

The number of books in the school library is an indicator of the extent to which 
schools are prepared to encourage students to read. To investigate this relation- 
ship in each country, school principals were asked to estimate how many books 
their libraries contained. The data show considerable diversity between coun- 
tries in average library size. Several developing countries, namely Botswana, 
the Philippines, Venezuela and Zimbabwe had predominantly small school 
libraries or none at all, while Denmark, Singapore, the United States, Canada 
(BC) and Slovenia typically had school libraries of more than 7,000 at both age 
levels. However, at the Population B level, schools in New Zealand, Sweden 
and Thailand also have an average of more than 7,000 books. 

As in previous surveys of individual countries, a clear link was found 
between reading ability and the size of school libraries. For each country the 
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schools were grouped into quarters by size of school library. The overall scores 
for each quarter in each country were then computed and the means aggregated 
across all countries (492, 500, 504, 5 1 5). A regular increase in average score was 
observed with increases in library size across all countries and within most of 
them. In Finland, Germany (E) and Italy the relationship was not so regular, 
but the data for all other countries are consistent with the proposition that a large 
stock of books is a prerequisite for an effective reading program. There is also 
an apparent difference between weal thier and poorer countries as defined by the 
GDI. Figure 7.2 illustrates this pattern for the top ten countries and the bottom 
ten countries on the GDI in relation to thv pattern for all countries. Apparently 
a threshold of advantage is found in the high GDI school systems in the third 
quarter. 




- y- All countries 



- ♦— Low GDI countries 



Lowest Quarter 2nd Quarter 3rd Quarter Highest Quarter 
Number of Books in Librfiry 



Figure 7.2. School library size by achievement: Population B 



Availability of bookstores 

Another aspect of children's accessibility to books is the availability of nearby 
bookstores. School principals were asked to indicate whether bookstores were 
available locally (within 30 minutes travel time), or nearby (in a neighboring 
town or city) or not available (within two hours traveling time). Only in the 
developing countries did substantial numbers of principals indicate that their 
students had the lowest access level (Figure 7.3), although most countries had 

^3 
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about 4 percent of such students. Just over 80 percent of I4-year-oId students, 
overall, had easy access to book stores. 

Furthermore, in 22 countries, the highest achievement was shown by 14- 
year-old students with easy access. By contrast, large numbers of students in the 
four lowest scoring countries had poor access. The average score for all these 
students was less than 380. 
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Figure 7.3. Access to bookstores in four developing countries 
and in all other countries: Population B 



Self Ratings in Reading 

How accurate are students' perceptions of their own ability in reading? Do these 
perceptions differ across countries? In this survey, students were asked to rate 
their ability on a four point scale: Very Good, Gocd, Average or Not Very Good. 

Figure 7.4 presents for Population A the percentage of students in each 
country who rated their ability in each category with the countries arranged in 
order of overall achievement level. For easier inteqjretation, the right hand side 
of the figure shows a graph of the percentage of students in each country who 
rated their ability as Good or Very Good, 

A study of this graph shows considerable variation in the ability of students 
to rate themselves internationally. Finland, France, Hong Kong and Singapore 
show high percentages of students (more than 44 percent) who claim to be 
Average or Not Very Good, yet their overall achievement levels are very strong. 
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Self-rating percenls 

Not Very 
Good 



Very 

Average Good 



Finland 


9 


37 


44 


10 


United States 


3 


17 


33 


47 


Sweden 


4 


19 


50 


27 


France 


15 


29 


35 


Zl 


Italy 


8 


33 


36 


15 


New Zealand 


8 


23 


35 


33 


Norway 


8 


28 


37 


26 


Iceland 


8 


23 


38 


31 


Hong Kong 


13 


65 


15 


6 


Singapore 


30 


28 


27 


15 


Switzerland 


8 


30 


38 


23 


Ireland 


9 


16 


34 


41 


Belgium/Fr 


9 


25 


36 


29 


Greece 


4 


16 


26 


53 


Spain 


15 


34 


28 


23 


Germany/W 
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Figure 7.4. Self-ratings at each of four levels, listed by order 
of national achievement level: Population A 

More confident, on this scale, are the students of Cyprus, Greece, Canada (BC) 
and the United States who rate themselves as Very Good. Only in the latter case 
would this confidence seem to be well justified. Indeed, there was no relation- 
ship between the percentage of students in a country rating their reading ability 
as Very Good and their national achievement level. This kind of discrepancy 
between achievement and self-perception on an international scale has been 
noted before (Lapointe et al. 1989) and clearly reflects cultural norms about 
niodesty. 

Of course, it is a very difficult task for students to view their ability in an 
international perspective. Within their own country there was in fact a much 
higher relationship between their ratings and their actual achievement levels, in 
r- iosi countries the correlations were between 0.25 and 0.55 with Narrative and 
Expository scores, and slightly less for Document scores. Only in Hong Kong, 
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Indonesia and Venezuela did students appear to have real difficulty in making 
assessments of this kind. In Germany (E), Denmark, Switzerland, Slovenia 
and Germany (W) they were very good at it. 



TV Viewing 
How much television do students watch? 

As television and video are prime contenders for children's potential reading 
time, it is appropriate to examine trends in TV viewing hours. Students were 
asked to estimate how often tbey watched TV daily, choosing from five time 
categories. Figure 7.5 shows the percentage of students in both age groups who 
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Figure 7.5. Mean hours daily TV viewing and percent of students 
reporting over five hours per day 
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claim to watch ove;r five hours per day, together with the mean number of 
reported hours based on all levels of viewing. These figures are based on 
students' recollections which may sometimes be inaccurate, but the similarity 
of the statistics for the two age levels is high and suggests reasonable accuracy » 
In Population A, the United States stands out. American 9-year-olds claim 
to watch three hours of television per day, and some 21 percent watch for over 
five hours per day. Many children are spending considerably more time in front 
of their TV sets than they spend in school Other heavy viewing countries, at this 
age, are New Zealand, and three Latin countries, Spain, Portugal and Venezu- 
ela, all close to 2.5 hours, while children of Canada (BC), Iceland, Finland, 
Hong Kong and Ireland report 2.4 hours per day. 

By contrast, children of France, Switzerland and Indonesia watch only 1 .4 
hours per school day on average, and many in these countries watch none at all. 
Such patterns leave considerably more time for leisure reading, if that is the 
student's preference. At the 14-year-old level the mean viewing hours are very 
similar although fewer pupils claim to watch over five hours daily. Students in 
Iceland, Hong Kong, Hungary and the Unfted States show the highest viewing 
rates, at 2.5 hours or more, while Botswana and Zimbabwe report an average of 
less than one hour daily. 

How does TV viewing affect reading literacy scores? 
How serious is it for their reading progress that students spend so much time in 
front of their TV screens? Could they be learning something there which pays 
off in their general reading? This is clearly not true for the majority, although 
further analysis may reveal exceptions. In most countries there was a negative 
relationship between reading achievement and level of viewing. Light viewers 
generally scored more highly. 

The most clear-cut cases of a downward sloping curve for heavy TV viewing 
at age nine are found in the United States, Switzerland, Belgium, France and 
Germany (W), whose achievement patterns are plotted in Figure 7.6. In such 
countries, light viewers score highly, heavy viewers pooriy. Whatever the 
viewing diet of these students is, it is apparently not beneficial to their reading. 

Similar patterns were found for these five countries at the 14-year-old level, 
and Denmark, New Zealand, and Ireland also showed regular downward 
slopes at that age. 

By contrast, there is a group of five countries in which moderately heavy 
viewing - up to three and a half hours daily - is associated with higher reading 
performance among 9-year-olds (Figure 7.7). Either these students have found 
ways of fitting both forms of activity into their lives, or the frequent TV viewing 
may actually contribute, indirectly, to better reading. In this respect there is a 
recently formulated hypothesis which gains support from the trends in Figure 
7.7. Most of the students in the countries represented in this figure are regularly 
exposed to imported foreign language films on their television channels. These 
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Figure 7.6. Pattern of decreasing reading achievement with 
increasing TV viewing: Population A 
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films are often shown with sub-titles in the local language. There is, in fact, 
recent experimental evidence to show that this practice is beneficial for 
children's reading (Neuman and Kostinen 1992). Regular experiences of rapid 
reading under highly motivating circumstances, with pictorial cues to support 
meaning, is apparently a productive practice for raising reading levels in 
younger students. This practice clearly merits further investigation. 

At th^ Population B level, the only countries to show an upward trend, 
favoring moderately heavy viewers, were the Philippines, Portugal, Slovenia, 
Venezuela and Zimbabwe. Most of these are countries where the actual presence 
of television may be an indicator of higher socio-economic status, so the figures 
could be misleading. In most countries, the downward trends confirm that heavy 
viewing is not readily compatible with high reading achievement at the 14-year- 
old level. 
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CHAPTER EIGHT 

HOW DOES ONE BEC OME 
A GOOD READER? 



Students at both age ^evels were asked to consider eleven different strategies 
which they might use if they wished to become a better reader, and to choose the 
three ways they believed were most important. The main purposes of this 
question were: 

1. To provide some information about the kinds of literacy acquisition 
strategies which were promoted by the teachers in each country, as 
perceived by the pupils. 

2. To reveal which strategies are most often associated with high achievement 
in each country. 

Table 8. 1 lists the eleven options from which the students chose, arranged in 
order of popularity for Population A. The percentages given for each population 
were calculated by averaging the percentages of students in each country who 
chose each option. All countries were given equal v/eight in this analysis. 

Table 8.1. Percentages of students choosing each strategy for becoming a good 
reader: Populations A and B 



Strategy choices 



Liking it. 

Having lots of time to read. 
Being able to concentrate well. 
Knowing how to sound out words. 
Learning the meaning of lots of words. 
Having many good books around. 
Lots of drill at the hard things. 
Having lots of reading for homework. 
Having a Uvely imagination. 
Having lots of written exercises. 
Being told how to do it. 

Inspection of tliis table reveals a similar pattern of popularity for botV age 
eroups. Most students give priority to likint^ it. luivini^ lots of rime for m iin}^. 
and concentrating, well The older students give more weight to leanuni^ the 
meanini^ of lots of words and having many i^ood hooks available than the 
v'^unger ones did, and understandably less to sounding out the words, a skill 
hopefully learnedat an earlier age. Few students see much virtue, inany country. 
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in written exercises, in reading homework, or in being told how to do it. Most 
seem to support the view that one improves one's reading with regular, 
interesting, concentrated reading. 

An examination of the patterns of responses for each country was not 
immediately fruitful, as the similarities were more apparent than the differences. 
It is possible that many of the less able 9-Year-olds were unable to respond with 
adequate insight to produce meaningful results. Therefore an analysis was made 
of the best five percent of readers in each country, as judged by the students' 
average score across all domains. These students typically scored above 600 
points except in two or three low-scoring countries. 

The percentage of "best readers" at Population A level in each countr\' was 
tabulated and converted into standard scores to reveal more readily any cross- 
cultural deviations. These scores were then plotted in Figure 8.1 for the ten 
highest-scoring and ten lowest-scoring countries, in order to identify patterns of 
response which were associated with more successful and less successful 
reading programs. This figure shows clear contrasts on strategies 4, 5, 6, 7, 9 and 
10. (The valuts for Figure 8.1 can be found in Appendix G.) 
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Figure 8.1. Ways to become a good reader: Responses from 
the top five percent of students in the ten highest-scoring and 
the ten lowest-scoring countries: Population A 
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Thus high-scoring countries differed from low-scoring countries in thr 
following ways. Students who were good readers in the high-scoring countries 
more often believed that one becomes a good reader by: 

1 . Having many good books around 

2. Having a lively imagination 

3. Learning many new words 

4. Doing many written exercises 

They saw little value in beiag able to sound out the words, or having lots of 
drill at the hard things. By contrast, the best readers in the low-scoring countries 
claimed that good reading will result if one: 

1 . Learns how to sound out the words 

2. Has regular drill at the hard things 

3. Does much reading for homework 

They see much less value in having a plentiful supply of good books, or 
having a lively imagination. 

As the best readers in most of these countries were of similar ability, it is 
reasonable to conclude that these contrasting views of the good readers reflect 
different philosophies of reading instruction in these systems of education. 
While the two groups of students have learned to excel in readin[ by means of 
different approaches, the fact that one style has apparently prevailed in the 
countries with greater numbers of competent readers should not be overlooked. 
Further analysis of clusters in these responses is cleariy warranted. 

At Population B level, very similar trends emerged. Good readers in the 
highest-scoring countries valued a plentiful supply of good books, a lively 
imagination, liking it and having lots of time. Good readers in the lowest-scoring 
countries saw little point in many books or liking reading, but put relatively more 
emphasis on being able to sound out the words, drilling the hard things, and 
being able to concentrate. Once again, reading was apparently seen in these 
countries as a serious, difficult process, requiring hard work and disciplined 
effort. In the high achieving countries it was viewed more as a pleasant, 
imaginative activity. 
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CHAPTER NINE 
VOLUNTARY READING PATTERNS 



One goal of reading instruction which is given high priority in most countries 
is the development of voluntary reading habits in children. Teachers, principals 
and most parents would like students to read regularly as a voluntary activity, 
both in and out of school. Researchers have shown that time invested in reading 
raises achievement levels (Morrow and Weinstein 1986, Anderson et al 1985) 
and helps citizens participate productively in their society (Graff 1981, Goody 
1968). 

However, the extent of students' reading activity is rarely assessed in any 
formal or systematic fashion. Certainly there have been numerous surveys of 
students' reading interests in many of the participating countries, and there is a 
limited body of evidence about the consistent factors that influence children's 
reading activity (Guthrie and Greaney 1991). 

It is a matter of concern to educators that a number of studies indicate that 
reading activity out of school is declining in spite of the greater variety of 
attractive books and magazines available to today's young people. Surveys 
conducted in the United States, Ireland, England, Scotland, and New 
Zealand, among others, have drawn attention to the small numbers of books 
read by typical students in their own leisure time (Guthrie and Greaney 1991), 
while classroom observation studies have often shown that too little reading 
occurs in school. For many students, then, the research appears to show that 
reading is something separate from real life, something to be learned at school 
and then used only if it cannot be avoided. If reading has a key role to play in 
extending students' interests and knowledge and preparing them for the work- 
place, then a balanced reading program should give students both the ability to 
read and the desire to do so. Without this desire, students will not participate 
fully in their society. 

An international survey provides an ideal opportunity to compare the 
voluntary reading activities reported by students of comparable ages in different 
countries. 

How were students' voluntary reading activities assessed? 
All students at each Population level were asked to complete a questionnaire 
which was intended to reveal how often and what sort of materials they read, at 
home and in school. The study of reading activity by means of questionnaires 
has a long established tradition in many of the participating countries, although 
the lEA researchers had no illusions about the problems of measurement 
involved. Within the limitations of time, national traditions and funding, it 
proved to be the only feasible approach. 
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Cross-cultural studies of reading interests have of course been attempted 
before using the same methodology, Thomdike (1973) surveyed the reading 
attitudes of 10- and 14-year-olds in 1 5 countries by means of questionnaire, and 
found consistently positive but low correlations between reported attitudes to 
reading and achievement in reading comprehension. In a parallel study of 
literature achievement, Purves (1973) found slightly higher correlations be- 
tween interest in literature and students' achievement scores at both the 14-year- 
old and pre-university levels. 

Greaney and Neuman (1990) used students' essays and questionnaires to 
analyze the functions of students' leisure reading at three age levels (8, 10 and 
13) in 15 countries, and found clear similarities across ages and cultures in the 
reported purposes of children' s reading. Persistent gender differences in reading 
interests across countries have been revealed in this and in other studies, in a 
variety of countries (e.g., Greaney [Ireland] 1980, Robinson and Weintraub 
[United States] 1973, Bardsley [New Zealand] 1991, Whitehead, Cappey, 
Maddren and Wellings [England] 1 977). Girls are found to read more often than 
boys, to read more often for enjoyment, and to prefer reading about a wider range 
of topics than the boys do. 

In a report for Unesco, Guthrie and Siefert (1984) summarized a set of 
sur\'eys of reading activity in several countries, using a variety of methods. 
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Prominent among them was an interview study conducted in 12 countries 
(Szalai 1972). Adult participants kept diaries of their use of time, and results 
showed many consistencies across cultures in the adults' leisure activities. 

The actual questions used in the lEA survey were pilot tested and revised in 
most of the participating countries. These trials showed the benefits of having 
the test administrators read the questions aloud to the 9-year-old students, and 
allowing them ample time to complete them. 

The major disadvantages of questionnaires in this context are widely known. 
When asked to estimate how often the)' read, students, especially at young age 
levels, often lack the insight to generalize about their behavior. Many literally 
do not know how many books they normally read in a week. Moreover, in many 
cultures students experience a strong pressure to respond according to what they 
believe the teachers, or other authorities would expect. This "compliance effect" 
or "social desirability factor" appears to vary across cultures, and probably 
distorts the univariate analysis reported here. Thus caution has been observed 
in the reporting, and is recommended in the interpretation. Where there are 
patterns of responses which indicate such desirability effects the results are not 
reported. The bulk of this section will focus on Population B results, which show 
evidence of higher reliability. 

Patterns of Voluntary Reading Activity 

Population B students were asked to estimate how often they read different 
kinds of books, magazines and newspapers, using a six point scale which varied 
from Almost Never to Almost Every Day. Students made ratings for 1 5 kinds of 
books, eight types of magazines and seven sections of newspapers. The scores 
for each scale were calculated to produce Total Voluntary Reading scores in 
each category - books, magazines and newspapers - for each student. These 
voluntary reading scores revealed different patterns of popular reading material 
in many countries. 

Figure 9.1 presents the voluntary reading scores for the countries where 
newspapers were read with greater frequency than magazines or books. News- 
papers are clearly very popular in most Scandinavian countries and Singapore; 
by contrast books are seldom read by students in these countries with the 
exception of Singapore, (The values for the figures in this chapter can be found 
in Appendix G.) 

Figure 9.2 presents the corresponding profiles for those countries in which 
magazines were more widely read. The countries which reported reading books 
more frequently than magazines or newspapers were all developing countries. 
As magazines and newspapers are less plentiful in these countries, the relative 
popularity of books may reflect the fact that books are more accessible from 
school. Figure 9.3 shows the high book reading patterns of these countries. 
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Not all countries showed unbalanced profiles. For contrast, Figure 9.4 
presents the results for those countries which showed uniformly high and 
uniformly low patterns of reading activity among 14-year~olds, All forms of 
reading are popular in Greece and Hungary. The countries in the lower half of 
the figure show low levels of voluntary reading of all types. 
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Figure 9.4. Voluntary reading: Countries with evenly distributed 
preferences: Population B 



Voluntary reading and access to books 

Not all students have ready access to reading materials. Likewise there are many 
students who are surrounded by books but who do not often read them. 

To what extent is voluntary reading a function of the reading availability of 
books at home? To investigate this matter, the total voluntary reading score was 
related to selected categories taken from the Books in the Home scale as reported 
by the 14-year-old students. In seven countries there was a strong relationship 
revealed between the number of books reported in the students' homes and the 
total amount of their voluntary reading across books, magazines, and newspa- 
pers. Figure 9.5 shows that the relationship was strongest in Trinidad and 
Tobago. Students in Singapore who have fewer than ten books at home read 
very little (score = 32). Those who report over 200 books at home read a great 
deal (score = 46). 
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By contrast, there are five countries wher^. the level of book ownership is 
largely unrelated to the amount of reading done (Figure 9.6). Several of these 
are countries with large school libraries and plentiful reading resources in the 
community. The students in these countries would therefore be less dependent 
on having a ready supply of books at home. 

Amount of voluntary reading by achievement level 

Numerous researchers have demonstrated that students who read ofte .d 
well. There is a positive correlation between volume of reading and achieve- 
ment levels. Is this generalization true for every country? 

In the present survey, Population A students were asked to estimate on a four 
point scale how often they read books, magazines, comics and newspapers in 
their leisure time. Their estimates were totaled, and the sums classified by 
quartiles, that is, the 25 percent who read the least to the 25 percent who read the 
most. Then the total achievement means of students in each quarter were 
calculated. 

Figure 9.7 shows the results of this analysis for Population A for the average 
of all countries and for seven individual countries. The general pattern is that 
students who read least in their spare time have the lowest average scores. In all 
27 countries, there was also a steady trend upward in achievement to the third 
quarter of voluntary reading, and in ten systems, to the highest quarter. On the 
other hand there were fifteen countries where there was a peak at the third 
quarter and a slight descent to the highest quarter (Figure 9.8). While this link 
does not prove the old adage that "one learns to read by reading" it is certainly 
consistent with such advice. The best readers do read often in all countries. 

At the Population B level the link between regular book reading and 
achievement declines (Figure 9.9). In Botswana, Zimbabwe, Venezuela, the 
Philippines, Finland, Sweden and Slovenia, frequent readers still read best, but 
in 24 countries the trend was different. The highest achievement was shown by 
those in the second or third quarters at this stage of their schooling. If there are 
direct benefits to be obtained from regular reading at this age, they appear to 
reach a peak at relatively low levels of voluntary reading in most systems. In the 
developing countries, however, it is clear from Figure 9.9 that most students do 
not reach that optimum level, even in the highest quarter of voluntary reading. 
The contrast between the trend lines in the top and bottom half of Figure 9.9 is 
quite striking. 

Thus the benefits of frequent voluntary reading were most obvious at a 
younger age and, at the 14-year-old level in some of the countries. These 
findings are consistent with the principle that regular plentiful reading is 
important to attain a high level of reading ability, as measured by these tests, but 
is less crucial for sustaining it. 

The patterns observed in magazine reading were similar to those of book 
reading, with a decrease in achievement in the highest levels of voluntary 
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reading. With newspaper reading the positive relationships with reading achieve- 
ment were even more obvious. In 2 1 countries, the highest scoring students were 
the most frequent newspaper readers. 

Further detailed analyses of students' voluntary reading will be reported in 
other publications. 
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APPENDIX B 



INTERNATIONAL VALIDITY OF 
THE lEA READING LITERACY TESTS 

How Comparable Across Countries Are the lEA 
Reading Literacy Tests? 

There are many who would doubt the feasibility of developing a single test of 
reading literacy which is equally appropriate in all the languages and cultures 
represented in this study. This skepticism arises from a belief that literacy is so 
firmly entrenched in the culture, that what, and how, and how well a student 
typically reads is unique to each culture, and different from all others. 

There are certainly many examples of reading exercises which have demon- 
strated such disparities. For instance, the ability of American students to read 
and comprehend a description of an Indian wedding, is clearly different from 
and inferior to that of Indian students reading the same description. Similarly in 
reading about a western wedding, Indian students have difficulties that Ameri- 
can students avoid (see Steffenson et al. 1979). Each cultural group brings a 
different set of assumptions and different kinds of background knowledge 
which assist them in making the inferences necessary in any reading task. Such 
examples are common in our experience, and in the reading literature. 

However, these graphic examples are carefully selected to make the point of 
cultural diversity. ^' exists also a set of reading materials which are common 
to all cultures ana : .lool systems, which are assumed to be known and 
understood by all. All countries have schools, with teachers, books, maps, 
graphs, timetables, and charts. All expect students to read and interpret fiction, 
to understand expository passages on familiar and unfamiliar topics, to study a 
range of similar topics in school and at home. Moreover, an earlier lEA study 
on classroom climate showed a remarkable similarity in school teaching and 
management patterns (Anderson et al. 1 989). More generally, it should be noted 
that students are typically brought up in families by adults, with whom they have 
relationships which are sometimes in conflict. They nearly all have access to 
television, libraries, stores, newspapers, magazines and comics, and many of 
these variables are very similar across nations. Despite the obvious diversity, 
there is much common experience in the countries represented in this survey. 

In planning the lEA reading literacy tests, it was the common features which 
were stressed. Passages dealing with topics unique to one culture were deliber- 
ately avoided. 

Thus, the following measures were undertaken to enhance the comparability 
of the tests used in this project. 
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International Validity of the lEA Reading Literacy Tests 



1. Discussions were held with National Rese^arch Coordinators (NRCs) to 
identify suitable and unsuitable topics for a:n international test. 

2. Each counuy was asked to submit passag^ps and items and 20 NRCs 
responded. \ 

3. The passages were selected by an intemation<il committee and duly edited 
by NRCs and their National Advisory Commi\ttees. 

4. All NRCs rated, for suitability, the passages and 3tcms proposed for the pilot 
tests, and unsuitable passages were dropped. 

5. Passages and items were translated according to carefully laid-down 
guidelines, and checked for problems. 

6. Cultural adaptations were made to the passages and items to ensure that 
peoples' names, place names, currencies and metrics were appropriate for 
each culture. 

7. All countries participated in the pilot tests to help identify remaining items 
unsuitable for any culture. This was achieved by conducting item analyses 
on the results and studying the patterns of student responses across 
countries. Any items which behaved differently across nations according 
to these analyses were dropped or modified. 

8. More specifically, Rasch analyses were undertaken on the results of both 
the pilot tests and the final tests, and any poor-fitting items were dropped. 
On the basis of this analysis, more than half the items were deleted after the 
pilot test at each age level. After the final test, six items were dropped from 
the Population A tests, and seven from the Population B tests. As the 
remaining test items were considered to be fitting the Rasch model well, 
within their respective domains, they were assumed to be measuring the 
same qualities in each country. In other words, the probability of a student 
getting any particular item correct, for a given level of score is the same for 
all countries. 

9. As a further check, items were also examined by a correlational method, to 
ensure that they were behaving similarly in the final tests. Correlations were 
computed between the p values of the items in each domain in each country 
and the mean p values across all countries. These coefficients showed very 
high correlations between the difficulty indices across countries. That is, if 
an item was difficult in one country it was found to be difficult in all 
countries. When compared in this way the mean rank orders of item 
difficulties was approximately 0.92 for Population A and 0.9 1 for Popula- 
tion B. 

1 0. Any single item which was poorly filling in one country but not others was 
omitted from that country's results and the Rasch procedure used to 
estimate the students' scores fairly without it. 

All these measures were taken to make the tests as appropriate as possible for 
each cultural group. Such measures are rarely undertaken so carefully within 
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most countries. While some minor features may still be found to exist which a 
few observers would perceive as lending a cultural bias, the statistics reveal that 
students in each country did in fact respond in a similar fashion to the items, 
allowing for differences in ability. Moreover the items did behave in similar 
fashion in each country. In other words, the test results are believed to be 
comparable across countries, as they would be within countries. 

Of course, it could be argued that by making the tests appropriate for all that 
they finished by being appropriate for no single country. Deletion of topics 
unique to any one culture could mean a test so devoid of interest that it lacks 
validity in all cultures. 

A study of the test passages, however, shows that the range of topics is still 
very wide, wider indeed than that found in most single sets of standardized 
reading tests. In the light of these considerations, the reader can have reasonable 
confidence that the test results were as comparable across countries as is any 
standardized test within a single country. They are not perfect, but they provide 
a defensible basis for making comparisons in the three domains tested. 
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APPENDIX C 
RATIONALE FOR SCORES USED 



In studies of this kind, it sometimes is necessary to exclude one or more items 
from analysis after testing for reasons not anticipated prior to testing. It may be 
necessary, for example, to remove an item from analyses in all countries if it did 
not function in practice as intended. Or, if test completion rates are uniformly 
low across many countries, a decision may be made to not analyze responses to 
the last few items on a test. 

Occasionally, an item is problematic in a particular country, perhaps because 
of errors of translation or some unanticipated country-specific consideration. 
When test results are analyzed using item response theory (IRT), it is possible 
to exclude items from analysis in particular countries without compromising the 
comparability of achievement measures across countries. 

The purpose of removing items from analysis (either entirely or in particular 
countries) is to ensure that results reflect as accurately as possible student 
achievement levels in each country. In particular, the purpose is to ensure that 
students' results on individual items are providing information about the 
achievement domain being measured, and are not contaminated by differences 
in how tests have been translated or administered in different countries. 

In this study, the question of excluding items from analysis arose as a result 
of known differences in testing conditions (e.g., times allowed for test comple- 
tion) in different countries and because of an unusual level of non-completion 
of the test in some countries. Given the high non-completion rates, consideration 
was given to the possibility of basing each student' s measure in the three reading 
domains on only the items obviously attempted by that student, excluding 
unanswered items at the end of the test. In this way, the influence of different 
testing conditions in different countries on students' reading scores might be 
reduced or eliminated. 

Although a case for basing achievement measures on only obviously 
attempted items can be made, and may be appropriate in other lEA studies, this 
was not done in the cuirent study for the following reasons: 

1 . The instructions to students were clear, that they should answer every item, 
that they should work quickly, and that they had 40 minutes to complete the 
test. Those students who followed these instructions and completed all 
items may well have been disadvantaged when their scores were compared 
with those who devoted all their time to the early part of the test, or were 
able to confine themselves to items they were sure about. 
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Rationale for Scores Used 



2. The time limits were agreed to by all NRCs and the Steering Committee 
during the test construction phase and were believed to be realistic. 
Students were allowed more than one minute per item. 

3. In some countries where many items were "Not Reached" it was observed 
that students frequentiy omitted items early in the test. Thus, it is not clear 
which items were omitted and which were "Not Reached". 

4. It is reasonable to suppose that many students failed to finish the tests 
because the longer and more difficult passages tended to be concentrated 
towards the end of the test sessions. 

It is recognized that the style of response to formal tests may differ from one 
country to another. Thus, it is possible that scores may have been higher in 
countries which had many students who did not complete the test. Their 
traditions may have encouraged them not to respond when they were unsure. For 
these countries, the scores in this booklet may be an underestimate. Under the 
circumstances there is no ready way of estimating their scores precisely. 




APPENDIX D 
TARGET POPULATIONS AND SAMPLES 



The two target populations were defined as follows: 

Population A: All students attending mainstream schools on a full-time basis 
at the grade level in which most students were aged 9:00 -9:11 
years during the first week of the eighth month of the school 
year. 

Population B: All students attending school on a full-time basis at the grade 
level in which most students are agL^d 14:00 - 14:11 years 
during the first week of the eighth month of the school year. 

From the definitions it can be seen that students in separate special education 
schools were excluded from the defined populations. 

Tables D.l and D.2 present for Populations A and B the percentage of 
students omitted from the defined population, the percentage of students not 
given the tests in the classroom during the test administration, the number of 
schools or classes in the planned sample and the number of schools or classes 
in the achieved sample (i.e., the number of school or classes for which data are 
available in the data files handed in). Those not given the tests during the testing 
session were those deemed a) unable to take any items on the test because of 
learning or physical disability (typically mainstreamed children); or b) to have 
insufficient knowledge of the language of the test even to follow the general 
instructions (typically recent immigrants). 

One prior requirement of the lEA Reading Literacy Study was that there 
should be a response rate of at least 80 percent of the schools or classes planned 
to be drawn. It will be noted that asterisks have been placed next to Nigeria, 
Thailand and Zimbabwe, countries ^vhich participated in Population B only. 
This is because the response rates were lower than 80 percent. Care should be 
exercised with data from these three populations. 

Information is given below on the nature of the students omitted from the 
defined population or on the definition of the population. For example, in the 
first row of Tables D.l and D.2 it can be seen that 3.6 percent and 3,8 percent 
of Belgian students have been omitted from Populations A and B respectively. 
In the notes below, ii will be seen that these are students from schools in the 
francophone administered part of Belgium who were instructed in Flemish or 
German, 
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1 02 Target Populations and Samples 



Table D. 1 . Information on omitted population* size of sample and school 
response rates for Population A 





POPULATION A 




St udents 


Schools 




% 


% 












Excluded 


Excluded 


Number 






% 


Country 


from 


during 


in fmal 


Planned Achieved Response 




defmed 


test 


sample 










pop. 












Bclgium.(Fr) 


3.6 


0.32 


2729 


150 


149 


99.3 


Canada (BC) 


1.2 


2.33 


2682 


157 


157 


100.0 


Cyprus 


0.0 


0.44 


1515 


182 


181 


99^ 


Dcnmarkt 


0.0 


3.27 


3368 


212 


209 


99.0 


X IlUcUliJ 


9.2 


0.00 


1557 


71 


71 


100.0 


France (State onlv) 


16.0 


0.00 


1887 


140 


136 


97.1 


Germany (E) 


0.0 


0.13 


1906 


100 


100 


100.0 


Germany (W) 


0.0 


0.85 


2953 


150 


150 


100.0 


Greece 


0.0 


2.98 


3616 


176 


175 


99,4 


Hong Kong 


2.6 


0.00 


3312 


167 


167 


100.0 


Hunffarv 


2.4 


0.00 


3174 


144 


144 


100.0 


Iceland (all schools) 


0.5 


1.43 


4129 


180 


180 


100.0 


Indonesia (7 provinces 
Ireland 


0.0 


0.00 


3393 


176 


174 


98.9 


4.2 


0.14 


2783 


134 


122 


91.0 


Italy (state only) 


8.6 


1. 10 


2281 


177 


154 


87.0 


Netherlands 


0.0 


0.18 


1737 


91 


91 


100.0 


New Zealand 


0.0 


0.32 


3058 


177 


176 


99.4 


Norway 


0.3 


1.43 


2566 


191 


191 


100.0 


Portugal (mainland only) 


0.0 


0.11 


2799 


165 


145 


87.9 


Singapore (all schools) 


0.0 


0.68 


7488 


206 


206 


100.0 


Slovenia 


0.0 


0.10 


3421 


140 


140 


100,0 


Spain 


11.1 


0.00 


8674 


324 


324 


100.0 


Sweden 


0.0 


0.91 


4358 


124 


123 


99.0 


Switzerland 


0.0 


0.80 


3411 


225 


225 


100.0 


Trinidad/Tobagot 


0.0 


0.01 


3687 


184 


182 


98.9 


United States 


4.9 


2.33 


6848 


200 


165 


82.5 


Venezuela 


0.2 


0.22 


4819 


181 


161 


89.0 



•rThese systems sampled classes and not schools. 
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Table D.2. Information on omitted populaiion, size of sample and school 
response rates for Population B. 



Country 





POPULATION B 




Students 


Schools 




% 


% 








% 




Excluded 


Excluded 


Number 








from 


during 


in final 


Planned Achieved Response 




defined 


test 


sample 










DOD. 














3.8 


0.00 


2796 


153 


144 


91.7 




0.0 


0.00 


4768 


137 


137 


100.0 




l.l 


0.38 


4830 


216 


197 


912 




0.0 


0.07 


1459 


52 


52 


100.0 




0.0 


0.51 


3832 


207 


209 


100.0 




12.4 


0.00 


1352 


71 


71 


100.0 




21.0 


0.00 


2582 


140 


136 


97.1 




0.0 


0.12 


1885 


100 


100 


100.0 




0.0 


0.36 


4302 


200 


196 


98.0 




1.4 


0.39 


3968 


148 


147 


99.3 




1.2 


0.00 


3160 


158 


158 


100.0 




0.25 


0,00 


3455 


1 AA 


1 AA 


1000 




2.6 


0.10 


4000 


124 


124 


100.0 




0.0 


0.1 1 


3817 


162 


151 


93.2 




A fi 


u.ou 


3180 


175 


173 


98.9 




0.0 


0.00 


3897 


174 


162 


93.1 




0.0 


0.34 


3174 


125 


124 


99.2 




0.0 


0.00 


2365 


136 


20 


58.8 




0.2 


0.47 


2446 


142 


138 


972 




0.0 


0.00 


9713 


245 


244 


99.6 


0 


0.0 


0.00 


3529 


136 


130 


95.6 




0.0 


0.00 


4893 


142 


142 


100.0 




0.0 


0.00 


3328 


139 


139 


100.0 




6.5 


0.00 


8945 


318 


318 


100.0 




0.0 


0.52 


3618 


149 


149 


100.0 




0.0 


0.34 


6488 


362 


322 


89.0 




0.8 


0.00 


2753 


217 


139 


64.0 




0.0 


0.00 


3044 


93 


93 


100.0 




4.9 


0.58 


3587 


204 


165 


80.9 




12 


0.20 


4434 


178 


162 


91.0 




0.0 


0.00 


2749 


192 


143 


74.5 



Belgium.(Fr, 
Botswana 
Canada (BC) 
Cyprus (ail schools) 
Dcnmarkt 
Finland 

France (Sutc only) 
Germany (E)t 
Gcnriany (W)t 
Greece 
Hong Kong 
Hungary 

Iceland (all schools) 
Ireland 

Italy (suie only) 
Netherlands 
New Zealand 
Nigeria* 
Norway 
Philippines 

Portugal (mainland onl> 
Singapore (all schools) 
Slovenia 
Spain 
Sweden 
Switzerland 
Thailand* 
TrinidadA'obago 
United Sutes 
Venezuela 
Zimbabwe* 



tJhese systems sampled classes and not schools. 

*These systems had a response rate of less than 80 percent. 
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Target Populations and Samples 



Belgium/French: 

Canada/BC: 
Finland: 

France: 



Germany/East: 

GermanyAVest: 

Greece: 
Hong Kong: 



Hungary: 

Iceland: 

Indonesia: 

Ireland: 

Italy: 
Nigeria: 

Norway: 
Philippines: 

Spain: 

Thailand: 
United States: 



Notes on Excluded Students 
From Deflned Target Populations 

All students in French-speaking Belgium instructed in Flem- 
ish or German were excluded. 

Students in Government Native Indian schools excluded. 
Swedish speaking, special education, and laboratory schools 
excluded. 

Overseas territories and private schools in mainland France 
were excluded. Private schools = 16 percent of all students at 
Pop A, 21 percent of all students at Pop B. 
Students in special schools for the handicapped and institu- 
tions for specially talented students were excluded (8 percent). 
Students in special schools for the handicapped and non- 
graded private schools were excluded (8.3 percent). 
Pop B 1.4 percent in evening schools excluded. 
International schools, ESF Foundation schools, schools not 
participating in Secondary School Places Allocation System 
(SSPA) and schools with class size of less than 20 were 
excluded. 

Very small schools in remote areas and ungraded schools were 
excluded. 

Schools where there were fewer than 5 students in target 
population were excluded. 

Excluded schools outside of Java, Riau (Sumatra) and East 
Nusa Tenggara. The included population accounts for 70 
percent of the population. 

Private schools and schools with fewer than 5 students in the 
target population were excluded. 
Non-government schools excluded. 

Excluded schools outside of Lagos, Ogun, Oyo, Ondo, Bendel, 
Kwara. 

Schools for Lapps excluded. 

Schools in earthquake and insurgency areas (about 39 percent 
of the population) excluded. 

Students from schools with fewer than 10 students in the 
defined grade and from schools where medium of instruction 
not Castillian Spanish were excluded. 
Laboratory schools and schools controlled by the Department 
of Fine Arts and Culture. 

Fifty states (Mainland, Alaska and Hawaii) constituted the 
target population. Students in eligible schools not capable of 
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taking test (about 4.9 percent of each population) were ex- 
cluded, 

Venezuela: Students attending private rural schools were excluded. 

Standard Errors of Sampling 

The standard errors of sampling were calculated by the jackknife technique. 
These are presented in various figures and tables. 

Confidence Limits 

Simultaneous confidence intervals controlling for all possible comparisons 
based on the Bonferroni procedures were calculated for the national mean scores 
presented in Figures 3, 1 , 3,2, 3,3 and 4, 1 , 4.2, 4,3 in the text. 
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ADJUSTMENT FOR AGE DIFFERENCES 

It is clear from Tables 3. 1 and 4. 1 that the mean ages of the national samples of 
students varied somewhat from one countr>' to another. Some variation was 
expected, as the target samples were selected by grade, not age. However, in 
Population A one country tested a sample whose mean age was 8,89 years, while 
four others had mean ages well above 10 years. At the Population B level, one 
sample had a mean age of 13.93 years, while seven others, mostly developing 
countries, had mean ages over 15.0 years. 

To what extent would these departures from the defined samples affect the 
national means? Can these means be adjusted to compensate for these differ- 
ences? There is no easy answer to these questions, as cross-sectional surveys do 
not normally provide enough information to make a reliable adjustment. 
However, the need for some such compensation was keenly felt by many in the 
project, so an approximation was attempted, using three independent ap- 
proaches. Fortunately, all three converged on a similar outcome, so there are 
reasonable grounds for taking their results seriously. 

1. Regression method 

At each population level the correlation between the mean age of each country's 
sample and its mean composite score was calculated, and a regression equation 
used to estimate new mean scores with age equated. Those countries with much 
older students and relatively low scores were deliberately omitted from these 
calculations. The observed correlation between age and achievement wa^ 0.2! 
(N = 25). The values for the slopes and intercepts were computed, the predicted 
scores were determined for each country and the residuals worked out. These 
were added to the country means, and the new values were taken as an 
approximate estimate of the country achievement means, on the assumption of 
equal age. The results of this exercise are shown in Tables E. 1 (Population A) 
and E,2 (Population B). This analysis produced scores which were very close to 
the original means for most countries. The only large changes were in Canada 
(BC) ( + 14), the Netherlands (+9), Portugal (-10), Venezuela (-15), and 
Indonesia ( - 1 6). Thus a difference of 1 2 months produced a change of 1 8 to 20 
points. At the 1 4-year-old level, the observed correlation between country mean 
age and mean composite score was again 0.21, and the resultant adjustments 
produced the following changes: Canada (BC) (+18), Italy ( + 16), Hungary 
(+ 1 4), Spain ( + 1 2), Belgium (Fr) { + 1 1 ), PoRTi-GAL ( -20), France (- 1 6), VhNEZU- 
HLA(-18),ZiMBABWE(-17), and Nigeria (-12). The remaining adjustments were 
relatively small. 
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Table E. 1 . Mean scores in the booklet and scores adjusted for age differences 
for three domains for Population A. 





Narrative 


Expository 


Documents 






Mean 


Adjusted 


Nlcan 




I^esui 




Score 




Scores 


for zzc 


Scores 


for CkKJt* 




for acc 


difference 


Deigiuni/r'r 


510 


509 


505 


CA/4 

504 


jUD 




-1 




502 


516 


499 




DUU 


314 


+14 


v^yprus 


492 


492 


475 




4/0 




0 


ueiuuarK 


463 


463 


Ann 
467 


40/ 


4yo 




0 


riniaiiu 


568 


569 


!)o9 


J IK) 






+1 


Li*«*tf% #^ j-» A 

rionce 


532 


527 


<ii 

j3j 


DZo 


jZ / 


3ZZ 


-5 




482 


A QT 

4o / 




AOS 

4yo 


DZZ 




+5 


A rm o n 
WCniliUijr' " 


491 


4VO 


AQn 
4y / 


DUZ 


DZU 




+5 




514 


521 


C 1 1 

511 


CIO 


4oo 


4yj 


+7 ' 


nong ^ong 


494 


491 


0U3 


<nn 
jUU 


jj4 


J J 1 


-3 


nungdiy 


496 


503 


493 


jUU 




S 1^ 

J lO 


+7 


f on/4 


518 


518 


< 1 T 


< IT 


< 1 Q 


3 ly 


0 


lIlUi/IlCMa 


hUZ 








'^69 


353 


-16 




< 1 o 

Mo 


DZD 








502 


+7 


lieu jr 


533 


532 


coo 

538 


JJ 1 


j1 / 


D ID 


-1 








ASH 




481 


490 


+9 




534 


530 


531 


527 


521 


517 


-4 


Norway 


525 


525 


528 


528 


519 


519 


0 


Portugal 


483 


473 


480 


470 


471 


461 


-10 


Singapore 


521 


528 


519 


526 


504 


511 


+7 


Slovenia 


502 


503 


489 


490 


503 


504 


+1 


Spain 


497 


493 


505 


501 


509 


505 


-4 


Sweden 


536 


536 


542 


542 


539 


539 


0 


Switzerland 


506 


507 


507 


508 


522 


• 523 


+1 


Trinidad/ 


455 


458 


458 


461 


440 


443 


+3 


Tobago 












546 




United States 


553 


549 


538 


534 


550 


-4 


Venezuela 


378 


363 


396 


381 


374 


359 


-15 
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Table E.2. Mean scores in the booklet and scores adjusted for age difference: 
for three domains for Population B. 



Belgium/Fr 
Botswana 
Canada/BC 
Cyprus 
Denmark 
Finland 
France 
Germany/E 
Germany/W 
Greece 
Hong Kong 
Hungary 
Iceland 
Ireland 
Italy 

Netherlands 
New Zealand 
Nigeria 
Norway 
Philippines 
Portugal 
Singapore 
Slovenia 
Spain 
Sweden 
Switzerland 
Thailand 
Trinidad/ 
Tobago 
United States 
Venezuela 
Zimbabwe 



Narrative 



Mean 

Scores 



Adjusted 
for age 



Expository 



Mean 
Scores 



Adjusted 
for age 



484 

340 

526 

516 

517 

559 

556 

512 

514 

526 

509 

530 

550 

510 

520 

506 

547 

402 

515 

421 

523 

530 

534 

500 

556 

534 

468 

482 

539 
407 
367 



495 

341 

544 

515 

517 

559 

540 

515 

521 

534 

498 

544 

548 

516 
536 
515 

540 
390 
514 
427 
503 
537 
534 
512 
556 
531 
457 
489 

532 
389 
350 



477 

339 

516 

492 

524 

541 

546 

523 

521 

508 

540 

536 

548 

505 

524 

503 

535 

406 

520 

439 

523 

539 

525 

495 

533 

525 

486 

485 



488 

340 

534 

491 

524 

541 

530 

526 

528 

516 

529 

550 

546 

511 

540 

512 

528 

394 

519 

445 

503 

546 

526 

507 

533 

522 

475 

492 



Documents 



Mean Adjusted 
Scores for age 



539 532 
433 415 
374 357 



483 

312 

522 

482 

532 

580 

544 

543 

532 

493 

557 

542 

509 

518 
501 
533 

552 
394 
512 
430 
523 
533 
537 
475 
550 
549 
478 
472 

528 
412 
373 



494 

313 

540 

481 

532 

580. 

528 

546 

539 

501 

546 

556 

507 

524 
517 
542 

545 

382 

511 

436 

503 

540 

538 

487 

550 

546 

467 

479 

521 
394 
356 
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2. Growth from 9 to 14 years 

The second approach taken was to estimate the amount v growth in all three 
domains, from 9 to 14 years, as indicated by gains on the common 14 anchor 
items, taken by students in both age groups, and then to divide by 5 to obtain an 
estimate of the amount of growth per year, on those items. This method 
produced the enclosed table of p values for each population, with the amount of 
growth calculated on the right. 

Table E.3 shows that an overall gain of 23.7 points -vas demonstrated over 
five years on these common items. No doubt this figure would have been 
somewhat higher if there had not been a ceiling effect evident on some of the 
Shark items. On the admittedly debatable assumption of equal increments in 
achievement over each of the intervening five years, from 9 to 14 years, one 
would arrive at an estimate of growth of 4.74 percent per year, which is 
equivalent to 19 score points. If the two easiest Shark items were omitted from 
this calculation, the corresponding gains would be 5.15 percent, or 21 score 
points. These figures are very similar to those produced by the regression 
method ( 1 8 to 20 points per year). 



Table E.3. Changes on anchor items from 9 to 14 years. 



Passage 


Item 


Population A 
p value % 


Population B 
p value % 


Difference 

% 


Temperature 


1 


73.1 


86.7 


13.5 




2 


26.3 


66.4 


40.1 




3 


38.8 


69.1 


30.3 




4 


40.8 


75.3 


34.5 




5 


63.6 


89.8 


26.2 


Marmot 


1 


53.0 


75.6 


22.6 




2 


49.0 


81.0 


32.0 




3 


40.9 


68.6 


27.7 




4 


40.0 


71.6 


31.6 


Shark 


1 


78.4 


89.8 


11.4 




2 


75.3 


90.6 


15.3 




3 


74.6 


86.5 


11.9 




4 


69.6 


86.9 


17.3 




5 


68.0 


85.6 


17.6 


Mean 








23.7 
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3. Empirical comparison of adjacent age groups. 

The empirical way to check the size of the gain in test scores over 1 2 months is 
to administer the tests to adjacent age groups from the same schools. Such a 
study was undertaken by the author in a small sample of five New Zealand 
schools with the Population A tests, administered under standardized condi- 
tions. The samples consisted of 212 students in Standards 3 and 4 (9- and 10- 
year-olds), in the same multigrade classrooms. As there is no difference in the 
curriculum or reading materials for these two grades, and as they were taught 
together in the same composite classes, the normal situation in New Zealand. 
it was assumed that variations in performance would be attributable to age. not 
to grade. 

The results of this investigation showed that 1 0-year-olds performed slightly 
better than 9-year-olds on all items, and that an increase of 1 2 months of age was 
equiv alent to a six percent gain in Total Score at the median (Table E.4). In 
schools where the 9-year-olds performed well there was an apparent ceiling 
effect which reduced these gains; in low scoring schools the gains were larger. 
While these figures might be found to vary slightly in other schools and other 
countries, they are reasonably consistent with the findings obtainedby the other 
two methods. A gain of five to six percent per year, or approximately 20 points 
over 12 months is a reasonable estimate of growth. Hence the adjusted scores 
produced in Tables E.l and E.2. 



Table E.4. Percentage mean scores on Population A tests (overall) for 9- and 
1 0-year-olds by school 



School 


9-year- 
old mean 


(N) 


1 0-year- 
old mean 


(N) 


Growth 

(%) 


A 


73.5 


35 


78.1 


31 


4.6 


B 


67.0 


31 


70.5 


32 


3.5 


C 


62.0 


9 


70.0 


12 


8.0 


D 


51.4 


11 


59.6 


15 


8.2 


E 


50.0 


21 


62.9 


15 


12.9 


Total 


63.7 


107 


69.8 


105 


6.1 
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APPENDIX F 
TABLE OF CORRELATIONS 

Table F. I . Intercorrelations for six basic indicators of national development 
(CDI), mean values, and total scores for Population A and 
Population B. 





I 2 


3 


4 


5 


6 


7 


8 


Mean 


GNP (Per capita in $ 


1. 00 .94 


.69 


-.73 


.78 


.63 


.60 


.64 


10,076 


US) 














.51 


K824 


2. Expenditure on 


1. 00 


.57 


-.64 


,76 


.56 


.46 


education (per student 


















inSUS) 














.73 


72.5 


3. Life expectancy (in 




1.00 


-.93 


.54 


.85 


.73 


years) 
4. % Low birth weight 






1.00 


-.66 


-.78 


-.69 


-.69 


7.6 


infants 














.61 


236.4 


5. Mean newspaper 








1.00 


.57 


.47 


circulation (per \000) 










1.00 


.64 


.70 


91.9 


6. % Adult literacy 










7. Total score Pop A 












1.00 


.83 


500.0 


8. Total score Pop B 














LOO 


500.0 
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APPENDIX G 

VALUES FOR FIGURES IN 
CHAPTERS 6, 7, 8 AND 9 

The values for each of the points plotted for the figures in Chapters 6. 7, 8 and 
9 are given below. When available, the standard errors of sampling are also 
given 

CHAPTER 6 

Figure 6.2. Mean scores for seven countries with advantage for urban students. 
Population A 

Village Small Large City 



Greece 

Hungary 

Indonesia 

Portugal 

Slovenia 

Trinidad/ 

Tobago 

Venezuela 





Town 


Town 




481 


499 


515 


524 


481 


509 


515 


519 


383 


425 


431 


450 


468 


495 


518 


516 


488 


497 


504 


513 


441 


456 


482 


531 


365 


369 


388 


394 



Fii^ure 6.3. Mean scores for countries with negligible differences between urban 
and rural areas: Population A 



Finland 
United States 
Sweden 
Belgium/Fr 
Denmark 



Village 


Small 
Town 


Large 
Town 


City 


568 


568 


572 


571 


547 


547 


547 


550 


540 


546 


529 


535 


508 


511 


499 


506 


470 


468 


482 


481 



Fi}>ure 6.4. Mean scores for three countries with advantage for rural students: 
Population A 

Village Small Large City 
Town Town 

New Zealand 542 533 526 525 

France 537 531 519 523 

Switzerland 515 513 507 504 
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Values for Figures in Chapters 6. 7. 8 and 9 



CHAPTER 7 



Figure 7.1. Average sccres (with one standard error of sampling) by number of 
books in home: Selected countries compared with all countries: 
Population A. 





0 


1-10 


11-50 


51- 


100 


101-200 


>200 


Finland 


469 (59.2) 


507 (17.0) 


562 (7.8) 


570 


(5.8) 


580 (6.7) 


571 (6.1) 


Hong Kong 


484 (7.3) 


514 (4.0) 


532 (5.1) 


533 


(7.7) 


527 (11.6) 


519 (11.2) 


Sweden 


463 (46.7) 


465 (22.2) 


507 (10.5) 


530 


(7.4) 


551 (6.4) 


547 (4.4) 


Trinidad/ 


404 (17.1) 


422 (8.5) 


443 (6.1) 


448 


(6.8) 


466 (8.4) 


474 (5.5) 


Tobago 
















United States 


484 (17.1) 


506 (7.9) 


525 (5.8) 


553 


(5.3) 


570 (5.7) 


555 (4.2) 


Venezuela 


357 (11.3) 


379 (5.3) 


389 (5.8) 


398 


(7.6) 


394 (9.8) 


400 (7.2) 


All countries 


430 


458 


487 


501 




514 


513 



Figure 7.2. Mean achievement by school library size: Population B 



High GDI 
countries 

All countries 
Low GDI 
countries 



Lowest 
quarter 


2nd 
quarter 


3rd 
quarter 


Highest 
quarter 


521 


525 


536 


535 


492 


500 


504 


515 


445 


452 


454 


474 



Figure 7.6, Pattern of decreasing reading achievement with increasing TV 
viewing: Population A (with one standard error of sampling) 



Hours 


Belgium/ 


France 


Switzerland 


United 


Germany/ 


viewing 


French 










States 


West 


0 


522 (11.9) 


536 


(1K2) 


535 


(1U2) 


564 


(15.5) 


495 (10.5) 


0.5 


508 (5.9) 


540 


(6.1) 


514 


(4.8) 


554 


(7.2) 


515 (4.8) 


1.5 


517 (6.0) 


537 


(8.4) 


515 


(5.5) 


561 


(5.8) 


508 (4.7) 


2.5 


512 (8.7) 


533 


(12.5) 


508 


(7.6) 


558 


(6.1) 


499 (7.6) 


3.5 


497 (11.5) 


524 


(21.8) 


494 


(12.0) 


551 


(6.4) 


493 (11.8) 


4.5 


493 (11.3) 


497 


(18.0) 


482 


(13.8) 


544 


(7.3) 


478 (15.1) 


5.5 


483 (11.7) 


476 


(13.5) 


477 


(15.8) 


527 


(5.1) 


472 (11.4) 




Values for Figures in Chapters 6, 7, 8 and 9 



Figure 7. 7. Paiiem of increasing reading achievement with moderately heavy 
TV viewing: Population A 



Hours 
viewing 


Finland 


Italy 


Norway 


Portugal 


Sweden 


0 


550 


(15.4) 


515 (18.1) 


528 (7.9) 


438 (14.1) 


517 


(24.8) 


0.5 


569 


(9.6) 


536 (7.0) 


522 (5.8) 


468 (7.6) 


532 


(6.7) 


1.5 


572 


(6.0) 


532 (6.7) 


529 (5.7) 


475 (6.0) 


545 


(5.2) 


2.5 


572 


(6.8) 


534 (8.7) 


532 (8.6) 


488 (7.6) 


546 


(6.6) 


3.5 


578 


(8.0) 


543 (12.6) 


536 (11.0) 


492 (10.4) 


551 


(9.1) 


4.5 


559 


(9.5) 


516 (14.4) 


519 (16.1) 


491 (10.4) 


536 


(13.3) 


5.5 


1 555 


(13.3) 


503 (12.0) 


508 (15.2) 


478 (8.6) 


493 


(14.9) 



t with one standard error of sampling) 



CHAPTER 8 

Figure 8. 1 . Ways to become a good reader: Responses from the top five percent 
of students in the ten highest-scoring and the ten lowest-scoring 
countries: Population A 

High-scoring Low-scoring 
countries countries 



Like it 
Lots of time 
Concentrate well 
Sound out words 
Leam new word 
Good books 
Drill at hard things 
Reading for homework 
Lively imagination 
Written exercises 
Being told 



-0.5 

-0.2 
0.6 

-4.9 
2.3 
3.0 

-0.3 
1.2 
1.7 
2.6 
0.0 



-0.2 
0.4 
0.7 
5.9 

-3.2 

-3.7 
2.4 
1.9 

-4.0 
0.0 
1.3 



1 18 Values for Figures in Chapters 6, 7, 8 and 9 

CHAPTER 9 



Figure 9. 1. Voluntary reading: Countries with students favoring newspapers: 
Population B 



News- Magazines Books 



papers 


Finland 


18 


13 


6 


Norway 


17 


10 


6 


Singapore 


17 


10 


12 


Sweden 


16 


13 


8 


Iceland 


15 


10 


7 



Figure 9.2. Voluntary reading: Countries with students favoring magazines: 
Population B 

News- Magazines Books 
papers 

Portugal 
Gerraany/E 
Netherlands 
Slovenia 



9 


13 


11 


9 


11 


7 


9 


10 


7 


10 


12 


11 



Figure 9.3. Voluntary reading: Countries with students favoring books: Popu- 
lation B 

News- Magazines Books 

Trinidad/ 
Tobago 
Nigeria 
Philippines 
Zimbabwe 
Botswana 



papers 


15 


13 


19 


13 


14 


22 


12 


13 


21 


10 


11 


18 


7 


8 


14 



1 o 



oapers 


14 


15 


15 


14 


15 


15 


12 


14 


15 


10 


8 


10 


12 


12 


12 


9 


10 


10 



Values for Figures in Chapters 6, 7, 8 and 9 ^ 

Figure 9A. Voluntary reading: Countries with evenly distributed preferences: 
Population B 

News- Magazines Books 



Cyprus 

Hungary 

Greece 

Canada/BC 

United States 

France 



Figure 9.5. Voluntary reading by books in the home: Countries with strong 
relationship: Population B 

Less than 5 1-100 More than 
10 200 

Cyprus 39(2.3) 44(1.1) 53(2.1) 

Zmbabwe 36(1.6) 45(3.4) 48(4.5) 

Greece 35(2.4) 43(1.5) 49(2.2) 

Trinidadyrobago 35 (4.8) 43 (1.1) 52 (0.7) 

Singapore 32(0.9) 39(0.7) 46(0.8) 

Slovenia 28(3.2) 33(1.2) 39(1.4) 

Sweden 27(2.9) 34(1.1) 40(0.9) 

(with one standard error of sampling) 



Figure 9.6. Voluntary reading by books in the home: Countries with slight 
relationship: Population B 

Less than 51-100 More than 
10 200 

United States 34(4.9) 36(2.6) 37(2.1) 

Germany/E 28(3.2) 27(1.2) 29(1.2) 

Denmark 27(2.6) 26(0.8) 30(0.7) 

New Zealand 27(4.3) 25(1.7) 291.3) 

Netherlands 23(3.5) 24(1.6) 27(1.3) 

(with one standard error of sampling) 
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Figure 9.7. Population A: Reading achievement closely related to levels of 
voluntary reading. 



Lower 
quarter 



2nd 
quarter 



3rd 
quarter 



Sweden 

Norway 

Iceland 

Germany/E 

Denmark 

Trinidad/Tobago 



502 (6.5) 
476 (7.4) 
479 (0.0) 
459 (8.4) 
419 (7.8) 
421 (5.6) 



542 (6.3) 
524 (5.7) 
517(0.0) 
495 (8.5) 
474 (7.2) 
443 (5.4) 



551(5.8) 
538 (6.5) 
533 (0.0) 
516(8.6) 
489 (7.1) 
468 (6.0) 



Highest 
quarter 



561 (5.6) 
547(5.1) 
542 (0.0) 
526 (7.9) 
517(6.4) 
474(6.1) 



(with one standard error of sampling) 



Fi^?«r^ 9. S. Population A: Reading achievement peaks in third quarter of 
voluntary reading. 





Lower 


2nd 


3rd 


Highest 




quarter 


quarter 


quarter 


quarter 


United States 


536(4.6) 


550 (5.0) 


.558(5.1) 


548 (5.1) 


France 


512(7.9) 


530 (8.2) 


546 (7,8) 


536 (7.5) 


Slovenia 


475 (4.9) 


495 (4.6) 


511 (5.0) 


509 (4.4) 


Hungary 


474 (5.4) 


495 (5.2) 


515 (5.0) 


512(5.0) 


Portugal 


461 (6.4) 


475 (6.0) 


490 (6.8) 


488 (6.3) 


Italy 


508 (7.1) 


531 (7.5) 


542 (7.3) 


538 (6.8) 


(with one standard error of sampling) 







Figure 9,9. Population B: Contrasts in relationships between reading achieve- 
ment and voluntary reading. 





Lower 


2nd 


3rd 


Highest 




quarter 


quarter 


quarter 


quarter 


France 


546 (6.5) 


559 (6.4) 


553 (6.4) 


543 (6.4) 


Hong Kong 


527 (5.3) 


542 (5.6) 


538 (5.6) 


535 (5.5) 


Germany/W 


515 (6.3) 


53 i (6.2) 


530 (6.2) 


520 (6.3) 


Italy 


508 (5.7) 


523 (5.7) 


519(5.6) 


512 (5.4) 


Cyprus 


485 (4.4) 


504 (4.4) 


502 (4.6) 


495 (4.0) 


Spain 


488 (4.3) 


4% (4.6) 


491 (4.6) 


485 (4.6) 


Thailand 


478(9.1) 


480 (8.9) 


481 (8.7) 


470 (9.2) 


Philippines 


418(4.0) 


431 (4.2) 


432 (4.0) 


438(4.1) 


Venezuela 


406 (4.2) 


422 (5.5) 


429 (5.6) 


432 (5.4) 


Zimbabwe 


359 (5.6) 


373 (6.1) 


378 (6.2) 


382(6.1) 


Botswana 


325 (4.0) 


329 (4.2) 


332 (4.3) 


336 (4.2) 


(with one standard error of sampling) 
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